-- Logs begin at Fri 2022-09-30 18:29:40 UTC, end at Fri 2022-09-30 19:53:19 UTC. -- Sep 30 19:20:39.977702 dv-cinder-860015-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 30 19:20:39.984933 dv-cinder-860015-1-iscsi devstack@n-api.service[105425]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 30 19:20:39.986903 dv-cinder-860015-1-iscsi devstack@n-api.service[105425]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 30 19:20:39 2022] *** Sep 30 19:20:39.986903 dv-cinder-860015-1-iscsi devstack@n-api.service[105425]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 30 19:20:39.986903 dv-cinder-860015-1-iscsi devstack@n-api.service[105425]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 30 19:20:39.986903 dv-cinder-860015-1-iscsi devstack@n-api.service[105425]: nodename: dv-cinder-860015-1-iscsi Sep 30 19:20:39.986903 dv-cinder-860015-1-iscsi devstack@n-api.service[105425]: machine: x86_64 Sep 30 19:20:39.986903 dv-cinder-860015-1-iscsi devstack@n-api.service[105425]: clock source: unix Sep 30 19:20:39.986903 dv-cinder-860015-1-iscsi devstack@n-api.service[105425]: pcre jit disabled Sep 30 19:20:39.987442 dv-cinder-860015-1-iscsi devstack@n-api.service[105425]: detected number of CPU cores: 4 Sep 30 19:20:39.987442 dv-cinder-860015-1-iscsi devstack@n-api.service[105425]: current working directory: / Sep 30 19:20:39.987442 dv-cinder-860015-1-iscsi devstack@n-api.service[105425]: detected binary path: /usr/bin/uwsgi-core Sep 30 19:20:39.987442 dv-cinder-860015-1-iscsi devstack@n-api.service[105425]: your processes number limit is 47680 Sep 30 19:20:39.987442 dv-cinder-860015-1-iscsi devstack@n-api.service[105425]: your memory page size is 4096 bytes Sep 30 19:20:39.987442 dv-cinder-860015-1-iscsi devstack@n-api.service[105425]: detected max file descriptor number: 2048 Sep 30 19:20:39.987442 dv-cinder-860015-1-iscsi devstack@n-api.service[105425]: lock engine: pthread robust mutexes Sep 30 19:20:39.987442 dv-cinder-860015-1-iscsi devstack@n-api.service[105425]: thunder lock: enabled Sep 30 19:20:39.987442 dv-cinder-860015-1-iscsi devstack@n-api.service[105425]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 30 19:20:39.987442 dv-cinder-860015-1-iscsi devstack@n-api.service[105425]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 30 19:20:40.026623 dv-cinder-860015-1-iscsi devstack@n-api.service[105425]: Python main interpreter initialized at 0x55dc96efa9c0 Sep 30 19:20:40.026623 dv-cinder-860015-1-iscsi devstack@n-api.service[105425]: python threads support enabled Sep 30 19:20:40.026623 dv-cinder-860015-1-iscsi devstack@n-api.service[105425]: your server socket listen backlog is limited to 100 connections Sep 30 19:20:40.026623 dv-cinder-860015-1-iscsi devstack@n-api.service[105425]: your mercy for graceful operations on workers is 90 seconds Sep 30 19:20:40.027009 dv-cinder-860015-1-iscsi devstack@n-api.service[105425]: mapped 403077 bytes (393 KB) for 2 cores Sep 30 19:20:40.027095 dv-cinder-860015-1-iscsi devstack@n-api.service[105425]: *** Operational MODE: preforking *** Sep 30 19:20:40.027313 dv-cinder-860015-1-iscsi devstack@n-api.service[105425]: *** uWSGI is running in multiple interpreter mode *** Sep 30 19:20:40.027313 dv-cinder-860015-1-iscsi devstack@n-api.service[105425]: spawned uWSGI master process (pid: 105425) Sep 30 19:20:40.027504 dv-cinder-860015-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 30 19:20:40.028561 dv-cinder-860015-1-iscsi devstack@n-api.service[105425]: spawned uWSGI worker 1 (pid: 105426, cores: 1) Sep 30 19:20:40.028561 dv-cinder-860015-1-iscsi devstack@n-api.service[105425]: spawned uWSGI worker 2 (pid: 105427, cores: 1) Sep 30 19:20:40.028561 dv-cinder-860015-1-iscsi devstack@n-api.service[105425]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 30 19:20:40.679127 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 30 19:20:40.683882 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 30 19:20:41.749483 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 30 19:20:41.749483 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: from cryptography.utils import int_from_bytes Sep 30 19:20:41.750127 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 30 19:20:41.750127 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: from cryptography.utils import int_from_bytes Sep 30 19:20:41.752552 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 30 19:20:41.752552 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: from cryptography.utils import int_from_bytes Sep 30 19:20:41.752984 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 30 19:20:41.752984 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: from cryptography.utils import int_from_bytes Sep 30 19:20:44.231561 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 30 19:20:44.232132 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 30 19:20:44.232329 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 30 19:20:44.232502 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 30 19:20:44.232868 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 30 19:20:44.232963 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 30 19:20:44.233060 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 30 19:20:44.233277 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 30 19:20:44.233375 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.233625 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.233720 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 30 19:20:44.233883 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 30 19:20:44.233981 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.234243 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.234347 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.234568 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.234662 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.234877 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.234972 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.235194 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.235282 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.235506 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.235679 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.235818 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.235911 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.236073 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.236165 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.236425 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.237080 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.237352 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-860015-1-iscsi {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.237505 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.237635 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.237744 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.237945 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.238065 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.238266 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-860015-1-iscsi {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.238375 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.238581 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.238679 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.238882 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.238995 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.239190 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.239286 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.239490 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.239599 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.239797 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.239989 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.240119 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.240439 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.240585 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.240758 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.240947 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.241062 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.241258 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.241355 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.241564 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.241666 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.241873 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.241963 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.242206 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.242297 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.242519 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.242627 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.242829 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.242918 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.243140 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.243243 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.243447 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.243546 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-860015-1-iscsi {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.243772 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.243872 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.244081 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.244178 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.244429 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.244530 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-860015-1-iscsi {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.244801 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.244900 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.245113 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.245226 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.245422 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.245524 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.245737 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.245834 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.246056 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.246147 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.246360 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.246458 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.246683 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.246779 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.246998 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.247099 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.247312 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.247403 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.247627 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.247724 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.247925 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.248031 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.248234 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.248324 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.248563 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.248656 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.248873 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.248975 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.249173 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.249262 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.249473 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.249570 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.249720 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.249820 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.250020 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.250126 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.250339 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.250437 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.250604 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.250726 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.250913 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.251072 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.251192 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.251292 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.251440 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.251537 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.251756 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.251858 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.252094 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.252194 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.252345 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.252489 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.252685 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.252774 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.253004 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.253110 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.253308 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.253397 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.253610 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.253703 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.253910 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.253998 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.254212 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.254309 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.254516 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.254611 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.254820 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.254913 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.255127 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.255226 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.255436 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.255536 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.255737 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.255835 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.256048 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.256141 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.256397 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.256489 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.256696 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.256785 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.257003 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.257091 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.257339 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.257435 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.257637 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.257748 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.257948 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.258077 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.258263 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.258371 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.258579 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.258677 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.258882 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.258970 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.259185 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.259326 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.259489 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.259585 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.259795 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.259888 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.260102 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.260202 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.260425 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.260532 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.260675 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.260763 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.260971 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.261074 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.261272 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.261372 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.261585 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.261673 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.261891 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.261987 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.262189 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.262278 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.262489 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.262585 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.262784 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.262881 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.263104 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.263205 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.263386 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.263475 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.263686 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.263775 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.263987 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.264077 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.264288 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.264486 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.264645 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.264730 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.264909 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.264999 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.265209 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.265329 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.265533 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.265624 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.265803 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.265900 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.266105 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.266203 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.266409 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.266499 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.266706 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.266806 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.267006 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.267107 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.267306 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.267398 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.267609 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.268400 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.268558 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.268703 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.268851 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.268987 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.269120 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.269260 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.269407 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.269560 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.269697 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.269848 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.269998 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.270132 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.270266 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.270409 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.270544 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.270677 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.270811 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.270951 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.271086 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.271232 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.271368 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.271512 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.271646 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.271797 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.271963 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.272122 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.272259 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.272423 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.272607 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.272744 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.272895 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.273031 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.273173 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.273308 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.273451 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.273595 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.273738 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.273872 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.274012 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.274147 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.274281 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.274414 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.274570 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.274718 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.274861 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.274995 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.275156 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.275309 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.275454 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.275589 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.275750 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.275931 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.276071 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.276204 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.276351 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.276523 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.276692 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.276835 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.276993 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.277144 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.277312 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:20:44.277457 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.277641 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.277781 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.277969 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.278126 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.278314 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.278455 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.278589 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.278723 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.278898 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.279049 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.279197 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.279332 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.279518 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.279660 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.279826 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.279969 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.280134 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.280276 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.280466 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.280620 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.280765 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.280910 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.281081 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.281235 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.281396 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.281544 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.281689 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.281833 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.282000 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.282149 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.282313 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.282453 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.282666 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.282804 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.282938 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.283083 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.283239 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.283925 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.284098 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.284242 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.284438 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.284583 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.284769 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.284911 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.285092 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.285235 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.285405 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.285554 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.285732 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.285881 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.286051 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.286193 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.286362 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.286504 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.286672 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.286833 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.286978 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.287121 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.287293 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.287434 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.287601 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.287760 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.287905 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.288048 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.288213 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.288413 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.288558 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.288709 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.288846 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.288981 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.289154 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.289553 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.289697 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.289832 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.290008 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.290149 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.290317 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.290458 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.290624 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.290777 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.290913 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.291048 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.291229 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.291379 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.291528 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.291664 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.291859 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.292002 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.292165 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.292305 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.292509 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.292649 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.292784 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.292918 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.293095 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.293239 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.293394 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.293531 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.293694 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.293847 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.293982 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.294126 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.294268 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.294409 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.294578 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.294720 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.294866 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.295013 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.295173 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.295330 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.295467 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.295610 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.295768 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.295919 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.296061 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.296210 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.296400 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.296553 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.296695 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.296847 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.296997 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.297138 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.297289 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.297430 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.297658 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.297820 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.297969 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.298117 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.298266 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.298451 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.298617 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.298761 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.298902 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.299562 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.299712 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.299854 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.300011 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.300165 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.300319 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.300491 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.300646 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.300796 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.300948 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.301091 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.301239 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.301380 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.301530 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.301683 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.301825 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.301966 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.302127 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.302269 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.302433 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.302590 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.302755 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.302905 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.303046 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.303186 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.303332 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.303486 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.303638 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.303779 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.303920 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.304071 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.304211 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.304361 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.304578 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.304720 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.304861 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.305001 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.305155 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.305297 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.305445 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.305587 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.305737 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.305886 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.306050 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.306200 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.306342 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.306491 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.306633 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.306785 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.306937 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.307079 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.307229 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.307379 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.307528 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.307676 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.307838 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.307989 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.308131 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.308282 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.308449 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.308647 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.308794 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.308935 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.309083 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.309225 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.309366 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.309536 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.309724 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.309881 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.310030 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.310173 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.310314 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.310464 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.310606 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.310746 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.310888 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.311030 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.311170 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.311324 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.311467 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.311615 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.311766 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.311908 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.312127 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.312272 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.312433 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.312581 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.312723 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.312864 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.313023 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.313167 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.313309 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.313450 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.313601 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.313755 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.313905 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.314048 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.314189 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.314330 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.314478 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.315160 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.315317 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.315460 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.315601 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.315742 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.315889 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.316030 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.316192 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.316335 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.316538 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.316683 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.316824 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.316973 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.317123 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.317266 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.317407 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.317548 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.317689 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.317839 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.317981 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.318133 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.318276 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.318417 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.318606 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.318764 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.318915 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.319056 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.319198 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.319339 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.319480 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.319630 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.319773 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.319924 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.320066 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.320207 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.320357 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.320528 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.320681 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.320831 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.320973 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.321114 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.321263 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.321407 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.321548 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.321689 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.321841 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.321990 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.322143 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.322285 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.322434 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.322579 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.322728 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.322870 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.323019 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.323162 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.323303 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.323445 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.323586 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.323749 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.323904 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.324046 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.324187 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.324328 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.324515 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.324750 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.324911 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.325054 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.325196 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.325338 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.325486 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.325645 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.325806 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.325948 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.326090 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.326231 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.326371 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.326521 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.326664 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.326812 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.326955 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.327095 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.327245 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.327387 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.327545 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.327695 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.327844 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.327985 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.328135 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.328284 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.328447 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.328592 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.328774 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.328932 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.329083 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.329232 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.329381 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.329533 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.329675 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.329816 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.329966 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.330141 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.330292 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.330444 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.330587 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.330736 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.330891 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.331041 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.331183 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.331324 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.331476 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.331626 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.331769 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.331940 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.332083 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.332226 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.332430 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.332592 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.332737 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.332879 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.333021 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.333171 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.333313 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.333473 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.333622 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.333763 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.333903 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.334052 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.334194 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.334343 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.334485 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.334626 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.334767 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.334915 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.335070 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.335218 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.335371 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.335512 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.335660 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.335802 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.335956 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.336099 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.336247 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.336426 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.336576 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.336718 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.336868 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.337016 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.337175 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.337317 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.337458 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.337599 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.337748 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.337890 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.338038 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.338180 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.338329 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.338480 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.338629 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.338812 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.338960 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.339114 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.339263 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.339412 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.339554 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.339695 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.339836 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.340060 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.340210 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.340504 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.340669 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.340813 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.340954 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.341103 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.341255 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.341406 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.341563 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.341719 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.341869 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.342011 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.342151 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.342302 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.342444 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.342613 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.342758 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.342899 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.343055 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.343197 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.343337 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.343491 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.343634 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.343775 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.343918 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.344059 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.344200 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.344353 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.344532 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.344674 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.344815 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.344967 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.345120 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.345270 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.345413 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.345554 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.345694 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.345864 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.346016 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.346167 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.346316 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.346458 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.346601 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.346742 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.346901 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.347044 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.347185 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.347325 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.347466 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.347609 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.347762 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.347911 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.348054 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.348202 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.348351 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.348548 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.348703 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.348897 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.349047 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.349196 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.349339 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.349489 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.349631 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.349781 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.349924 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.350065 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.350207 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.350363 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.350519 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.350672 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.350814 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.350956 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.351105 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.351248 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.351389 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.351530 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.351670 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.351811 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.351959 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.352102 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.352243 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.352412 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.352579 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.352722 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.352876 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.353026 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.353167 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.353315 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.353465 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.353606 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.353756 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.353906 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.354055 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.354196 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.354336 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.354487 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.354636 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.354779 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.354921 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.355060 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.355202 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.355356 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.355498 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.355639 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.355780 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.355920 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.356061 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.356211 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.356412 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.356564 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.356706 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.356846 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.356998 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.357150 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.357293 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.357435 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.357582 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.357724 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.357865 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.358019 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.358179 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.358322 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.358464 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.358604 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.358753 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.358895 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.359078 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.359222 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.359370 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.359510 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.359664 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.359806 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.359946 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.360104 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.360254 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.360417 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.360581 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.360732 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.360875 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.361016 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.361156 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.361298 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.361974 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.362124 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.362267 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.362408 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.362571 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.362732 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.362874 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.363034 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.363227 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.363375 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.363516 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.363733 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.363885 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.364028 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.364178 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.364320 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.364520 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.364687 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.364831 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.364973 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.365114 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.365255 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.365405 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.365556 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.365756 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.365903 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.366044 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.366194 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.366353 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.366496 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.366657 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.366799 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.366948 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.367102 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.367257 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.367398 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.367541 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.367682 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.367823 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.367964 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.368119 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.368270 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.368439 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.368589 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.368730 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.368872 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.369072 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.369221 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.369370 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.369520 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.369663 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.369813 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.369967 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.370118 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.370260 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.370411 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.370559 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.370710 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.370852 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.371000 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.371142 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.371283 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.371431 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.371585 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.371728 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.371869 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.372023 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.372164 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.372323 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.372518 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.372671 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.372814 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.372962 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.373111 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.373262 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.373404 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.373544 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.373691 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.373835 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.373983 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.374134 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.374293 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.374436 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.374576 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.374717 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.374859 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.374859 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.375137 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.375284 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.375433 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.375575 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.375716 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.375870 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.376013 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.376163 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.376305 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.376479 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.376622 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.376781 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.376933 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.377135 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.377285 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.377436 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.377596 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.377739 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.377887 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.378045 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.378187 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.378336 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.378486 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.378628 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.378768 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.378909 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.379051 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.379234 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.379385 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.379527 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.379668 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.379809 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.379960 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.380115 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.380264 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.380264 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.380591 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.380734 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.380874 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.381024 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.381168 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.381316 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.381458 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.381599 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.381740 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.381740 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.382032 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.382174 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.382324 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.382472 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.382617 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.382767 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.382909 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.382909 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.383182 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.383325 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.383475 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.383634 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.383779 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.383919 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.384067 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.384209 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.384360 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.384360 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.384666 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.384809 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.384950 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.385101 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.385256 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.385400 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.385551 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.385699 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.385842 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.385983 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.386132 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.386275 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.386470 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.386617 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.386759 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.386958 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.387109 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.387258 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.387401 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.387401 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.387687 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.387687 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.387965 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.387965 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.388242 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.388437 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.388597 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.388749 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.388897 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.389040 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.389230 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.389378 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.389534 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.389703 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.389854 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.390005 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.390155 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.390297 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.390438 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.390588 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.390731 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.390884 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.391034 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.391178 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.391336 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.391485 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.391628 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.391778 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.391921 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.392062 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.392203 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.392353 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.392544 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.393212 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.393358 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.393500 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.393650 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.393810 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.393965 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.394109 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.394251 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.394392 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.394541 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.394685 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.394836 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.394979 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.395134 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.395277 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.395419 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.395568 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.395722 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.395865 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.396007 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.396149 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.396308 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.396490 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.396664 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.396817 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.396996 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.397148 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.397291 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.397441 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.397594 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.397737 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.397879 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.398021 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.398170 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.398321 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.398471 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.398678 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.398827 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.398978 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.399130 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.399316 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.399464 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.399616 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.399758 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.399899 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.400050 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.400193 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.400335 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.400531 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.400685 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.400828 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.400980 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.401675 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.401822 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.401977 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.402121 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.402309 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.402455 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.402597 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.402739 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.402881 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.403034 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.403188 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.403331 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.403473 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.403614 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.403764 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.403926 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.404069 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.404212 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.404354 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.404521 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.404664 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.404827 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.404970 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.405112 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.405255 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.405255 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.405535 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.405691 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.405846 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.405846 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.406122 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.406264 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.406417 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.406560 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.406701 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.406843 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.406984 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.407126 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.407276 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.407419 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.407577 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.407720 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.407869 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.408012 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.408162 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.408357 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.409048 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.409202 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.409388 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.409538 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.409776 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.409968 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.410115 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.410268 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.410411 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.410563 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.410706 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.410848 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.410989 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.411131 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.411272 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.411432 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.411576 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.411717 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.411858 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.412000 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.412160 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.412311 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.412480 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.412625 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.412766 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.412908 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.413059 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.413214 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.413357 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.413498 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.413640 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.413781 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.413931 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.414094 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.414496 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.414642 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.414791 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.414934 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.415084 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.415226 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.415367 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.415509 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.415658 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.415801 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.415951 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.416104 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.416245 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.416434 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.416593 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.416737 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.416950 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.417095 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.417237 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.417386 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.417529 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.417529 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.417814 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.417958 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.418111 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.418260 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.418402 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.418554 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.418696 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.418838 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.418980 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.419127 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.419277 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.419277 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.419608 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.419758 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.419909 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.420063 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.420212 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.420377 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.420544 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.420688 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.420831 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.420981 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.421132 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.421276 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.421418 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.421559 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.421709 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.421862 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.422014 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.422157 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.422299 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.422440 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.422581 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.422723 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.422873 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.423027 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.423172 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.423321 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.423477 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.423638 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.423781 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.423949 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.424095 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.424237 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.424434 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.424596 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.424740 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.424891 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.425034 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.425183 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.425335 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.425491 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.425640 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.425784 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.425926 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.426067 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.426224 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.426367 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.426509 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.426651 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.426792 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.426942 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.427092 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.427252 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.427396 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.427546 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.427689 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.427848 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.427992 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.428133 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.428274 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.428449 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.428605 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.428756 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.428899 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.429051 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.429192 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.429192 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.429469 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.429675 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.429820 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.429961 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.430102 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.430244 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.430394 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.430537 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.430679 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.430821 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.430972 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.430972 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.431250 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.431393 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.431535 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.431677 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.431824 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.431967 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.432118 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.432260 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.432423 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.432596 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.432759 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.432917 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.433078 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.433229 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.433371 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.433514 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.433657 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.433807 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.433958 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.434101 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.434251 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.434394 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.434535 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.434776 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.434930 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.435108 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.435257 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.435400 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.435540 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.435714 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.435870 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.436035 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.436184 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.436334 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.436526 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.436673 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.436887 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.437038 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.437234 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.437391 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.437547 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.437690 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.437855 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.438004 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.438156 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.438299 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.438450 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.438600 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.438756 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.438906 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.439057 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.439200 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.439351 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.439515 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.439701 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.439849 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.439991 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.440142 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.440285 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.440475 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.440576 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.440663 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.440843 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.440954 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.441148 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.441239 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.441462 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.441560 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.441759 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.441862 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.442061 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.442153 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.442363 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.442455 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.442666 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.442764 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.442967 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.443066 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.443271 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.443359 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.443567 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.443656 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.443874 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.443970 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.444176 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.444263 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.444503 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.444603 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.444808 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.444899 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.445115 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.445212 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.445427 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.445519 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.445732 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.445821 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.446030 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.446119 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.446333 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.446430 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.446641 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.446730 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.446944 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.447044 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.447264 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.447362 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.447573 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.447662 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.447878 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.447981 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.448182 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.448279 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.448511 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.448603 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.448828 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.449063 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.449163 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.449398 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.449511 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.449716 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.449804 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.450048 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.450139 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.450379 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.450469 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.450687 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.450785 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.450994 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.451214 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.451312 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.451555 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.451653 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.451879 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.451970 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.452196 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.452284 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.452531 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.452623 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.452843 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.452933 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.453150 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.453238 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.453455 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.453546 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.453764 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.453861 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.454072 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.454168 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.454378 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.454481 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.454686 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.454775 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.454994 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.455084 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.455814 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.455917 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.456124 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.456221 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.456451 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.456546 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.456765 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.456867 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.457077 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.457166 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.457390 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.457480 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.457703 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.457794 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.458013 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.458102 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.458324 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.458411 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.458627 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.458717 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.458935 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.459024 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.459241 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.459330 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.459553 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.459644 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.459866 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.459955 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.460192 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.460289 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.460537 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.460631 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.460839 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.460930 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.461150 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.461462 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.461566 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.461775 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.461878 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.462090 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.462180 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.462419 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.462511 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.462728 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.462816 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.463032 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.463125 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.463358 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.463670 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.463765 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.463993 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.464089 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.464305 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.464448 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.464703 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.464800 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.464968 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.465058 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.465295 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.465386 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.465614 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.465704 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.465920 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.466027 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.466226 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.466316 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.466530 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.466620 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.466837 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.466935 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.467155 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.467246 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.467463 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.467559 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.467765 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.467864 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.468068 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.468158 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.468390 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.468482 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.468699 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.468804 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.469002 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.469092 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.469308 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.469397 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.469610 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.469701 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.469912 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.469999 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.470211 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.470300 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.470514 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.470604 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.470863 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.471451 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.471672 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.471772 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.471975 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.472070 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.472276 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.472385 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.472606 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.472694 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.472909 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.473000 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.473208 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.473295 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.473507 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.473605 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.473806 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.473894 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.474105 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.474193 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.474409 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.474573 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.474719 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.474831 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.475022 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.475112 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.475326 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.475424 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.475630 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.475720 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.475934 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.476031 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.476238 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.476340 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.476582 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.476672 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.476905 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.476994 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.477218 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.477306 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.477523 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.477618 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.477837 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.477926 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.478148 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.478244 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.478455 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.478543 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.478762 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.478857 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.479073 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.479170 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.479386 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.479475 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.479692 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.479788 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.480013 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.480101 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.480329 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.480438 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.480657 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.480762 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.480970 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.481058 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.481283 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.481372 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.481639 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.481748 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.481905 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.482004 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.482217 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.482317 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.482539 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.482642 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.482845 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.482934 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.483149 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.483237 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.483456 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.483547 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.483766 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.483855 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.484074 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.484163 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.484408 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.484500 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.484710 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.484799 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.485018 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.485121 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.485329 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.485417 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.485640 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.485728 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.485951 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.486050 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.486262 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.486351 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.486591 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.486679 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.486902 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.486998 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.487214 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.487303 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.487532 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.487629 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.487849 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.487947 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.488177 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.488267 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.488526 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.488618 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.488837 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.488933 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.489144 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.489234 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.489454 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.489543 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.489695 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 30 19:20:44.489807 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.490129 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.490474 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.490806 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.491123 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.491438 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.491746 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:20:44.491990 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 30 19:20:44.641693 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: INFO dbcounter [None req-b3da9425-889a-47d9-ae58-6f2d2abc0ea8 None None] Registered counter for database nova_api Sep 30 19:20:44.643909 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: INFO dbcounter [None req-efbe9e24-df44-40df-a583-9df3bb246835 None None] Registered counter for database nova_api Sep 30 19:20:44.662415 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG oslo_db.sqlalchemy.engines [None req-b3da9425-889a-47d9-ae58-6f2d2abc0ea8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105426) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 30 19:20:44.664145 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG oslo_db.sqlalchemy.engines [None req-efbe9e24-df44-40df-a583-9df3bb246835 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105427) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 30 19:20:44.669369 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG dbcounter [-] [105426] Writer thread running {{(pid=105426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 30 19:20:44.670802 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG dbcounter [-] [105427] Writer thread running {{(pid=105427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 30 19:20:44.724879 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.context [None req-b3da9425-889a-47d9-ae58-6f2d2abc0ea8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd(cell1) {{(pid=105426) load_cells /opt/stack/nova/nova/context.py:464}} Sep 30 19:20:44.726756 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.context [None req-efbe9e24-df44-40df-a583-9df3bb246835 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd(cell1) {{(pid=105427) load_cells /opt/stack/nova/nova/context.py:464}} Sep 30 19:20:44.728721 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG oslo_concurrency.lockutils [None req-b3da9425-889a-47d9-ae58-6f2d2abc0ea8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:20:44.729191 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG oslo_concurrency.lockutils [None req-b3da9425-889a-47d9-ae58-6f2d2abc0ea8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:20:44.730617 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG oslo_concurrency.lockutils [None req-efbe9e24-df44-40df-a583-9df3bb246835 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:20:44.730780 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG oslo_concurrency.lockutils [None req-b3da9425-889a-47d9-ae58-6f2d2abc0ea8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:20:44.731090 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG oslo_concurrency.lockutils [None req-efbe9e24-df44-40df-a583-9df3bb246835 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:20:44.731492 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG oslo_concurrency.lockutils [None req-b3da9425-889a-47d9-ae58-6f2d2abc0ea8 None None] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:20:44.731980 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG oslo_concurrency.lockutils [None req-b3da9425-889a-47d9-ae58-6f2d2abc0ea8 None None] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:20:44.732705 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG oslo_concurrency.lockutils [None req-efbe9e24-df44-40df-a583-9df3bb246835 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:20:44.733430 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG oslo_concurrency.lockutils [None req-efbe9e24-df44-40df-a583-9df3bb246835 None None] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:20:44.733874 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG oslo_concurrency.lockutils [None req-efbe9e24-df44-40df-a583-9df3bb246835 None None] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:20:44.733966 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG oslo_concurrency.lockutils [None req-b3da9425-889a-47d9-ae58-6f2d2abc0ea8 None None] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:20:44.735865 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG oslo_concurrency.lockutils [None req-efbe9e24-df44-40df-a583-9df3bb246835 None None] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:20:44.735957 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: INFO dbcounter [None req-b3da9425-889a-47d9-ae58-6f2d2abc0ea8 None None] Registered counter for database nova_cell0 Sep 30 19:20:44.738432 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: INFO dbcounter [None req-efbe9e24-df44-40df-a583-9df3bb246835 None None] Registered counter for database nova_cell0 Sep 30 19:20:44.740477 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: INFO dbcounter [None req-b3da9425-889a-47d9-ae58-6f2d2abc0ea8 None None] Registered counter for database nova_cell1 Sep 30 19:20:44.742391 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: INFO dbcounter [None req-efbe9e24-df44-40df-a583-9df3bb246835 None None] Registered counter for database nova_cell1 Sep 30 19:20:44.748199 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG oslo_db.sqlalchemy.engines [None req-b3da9425-889a-47d9-ae58-6f2d2abc0ea8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105426) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 30 19:20:44.749890 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG oslo_db.sqlalchemy.engines [None req-b3da9425-889a-47d9-ae58-6f2d2abc0ea8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105426) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 30 19:20:44.751308 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG oslo_db.sqlalchemy.engines [None req-efbe9e24-df44-40df-a583-9df3bb246835 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105427) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 30 19:20:44.755433 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG dbcounter [-] [105426] Writer thread running {{(pid=105426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 30 19:20:44.755918 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG dbcounter [-] [105427] Writer thread running {{(pid=105427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 30 19:20:44.756591 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG oslo_db.sqlalchemy.engines [None req-efbe9e24-df44-40df-a583-9df3bb246835 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105427) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 30 19:20:44.760617 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG dbcounter [-] [105426] Writer thread running {{(pid=105426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 30 19:20:44.902429 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG dbcounter [-] [105427] Writer thread running {{(pid=105427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 30 19:20:44.904407 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: INFO dbcounter [None req-b3da9425-889a-47d9-ae58-6f2d2abc0ea8 None None] Registered counter for database nova_cell0 Sep 30 19:20:44.911802 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: INFO dbcounter [None req-efbe9e24-df44-40df-a583-9df3bb246835 None None] Registered counter for database nova_cell0 Sep 30 19:20:44.913680 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG oslo_db.sqlalchemy.engines [None req-b3da9425-889a-47d9-ae58-6f2d2abc0ea8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105426) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 30 19:20:44.918625 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG dbcounter [-] [105426] Writer thread running {{(pid=105426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 30 19:20:44.920604 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG oslo_db.sqlalchemy.engines [None req-efbe9e24-df44-40df-a583-9df3bb246835 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105427) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 30 19:20:44.925917 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG dbcounter [-] [105427] Writer thread running {{(pid=105427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 30 19:20:45.267754 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: WARNING keystonemiddleware.auth_token [None req-b3da9425-889a-47d9-ae58-6f2d2abc0ea8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 30 19:20:45.268343 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: WARNING keystonemiddleware.auth_token [None req-efbe9e24-df44-40df-a583-9df3bb246835 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 30 19:20:45.268732 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: WARNING keystonemiddleware.auth_token [None req-b3da9425-889a-47d9-ae58-6f2d2abc0ea8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 30 19:20:45.268822 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: WARNING keystonemiddleware.auth_token [None req-efbe9e24-df44-40df-a583-9df3bb246835 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 30 19:20:45.606212 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: WARNING keystonemiddleware.auth_token [None req-b3da9425-889a-47d9-ae58-6f2d2abc0ea8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 30 19:20:45.609596 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: WARNING keystonemiddleware.auth_token [None req-efbe9e24-df44-40df-a583-9df3bb246835 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 30 19:20:45.612184 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: WARNING keystonemiddleware.auth_token [None req-b3da9425-889a-47d9-ae58-6f2d2abc0ea8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 30 19:20:45.615650 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: WARNING keystonemiddleware.auth_token [None req-efbe9e24-df44-40df-a583-9df3bb246835 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 30 19:20:45.617669 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55dc96efa9c0 pid: 105426 (default app) Sep 30 19:20:45.619738 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-b3da9425-889a-47d9-ae58-6f2d2abc0ea8 None None] Calling method '>' {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:20:45.620933 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55dc96efa9c0 pid: 105427 (default app) Sep 30 19:20:45.621025 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-b3da9425-889a-47d9-ae58-6f2d2abc0ea8 None None] 10.222.0.17 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001752 Sep 30 19:20:45.621331 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 1/1] 10.222.0.17 () {50 vars in 788 bytes} [Fri Sep 30 19:20:45 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:22:06.786945 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-efbe9e24-df44-40df-a583-9df3bb246835 None None] Calling method '>' {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:22:06.788142 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-efbe9e24-df44-40df-a583-9df3bb246835 None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001967 Sep 30 19:22:06.788630 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 1/2] 10.222.0.17 () {54 vars in 931 bytes} [Fri Sep 30 19:22:06 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:22:06.804651 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG dbcounter [-] [105426] Writing DB stats nova_api:SELECT=3 {{(pid=105426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:22:06.805504 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG dbcounter [-] [105426] Writing DB stats nova_cell0:SELECT=3 {{(pid=105426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:22:06.806228 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG dbcounter [-] [105426] Writing DB stats nova_cell1:SELECT=3 {{(pid=105426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:22:06.807463 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG dbcounter [-] [105426] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:22:07.648836 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-c688116a-fac3-4b12-bd24-042a83b28e1d admin admin] Calling method '>' {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:22:07.682275 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-c688116a-fac3-4b12-bd24-042a83b28e1d admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.887515 Sep 30 19:22:07.683014 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 2/3] 10.222.0.17 () {60 vars in 1292 bytes} [Fri Sep 30 19:22:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:22:10.273390 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-efbe9e24-df44-40df-a583-9df3bb246835 None None] Calling method '>' {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:22:10.274457 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-efbe9e24-df44-40df-a583-9df3bb246835 None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Sep 30 19:22:10.275580 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 2/4] 10.222.0.17 () {54 vars in 931 bytes} [Fri Sep 30 19:22:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:22:10.755030 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-1c3bd23d-f683-4a3a-a77e-d1545c534aca admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "disk": 1, "rxtx_factor": 1.0, "name": "cirros256", "vcpus": 1, "id": "c1", "swap": 0}} {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:22:10.802478 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-1c3bd23d-f683-4a3a-a77e-d1545c534aca admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.520401 Sep 30 19:22:10.803054 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 3/5] 10.222.0.17 () {64 vars in 1283 bytes} [Fri Sep 30 19:22:10 2022] POST /compute/v2.1/flavors => generated 407 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 30 19:22:10.817153 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG dbcounter [-] [105427] Writing DB stats nova_api:SELECT=3 {{(pid=105427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:22:10.819183 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG dbcounter [-] [105427] Writing DB stats nova_cell0:SELECT=3 {{(pid=105427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:22:10.819982 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG dbcounter [-] [105427] Writing DB stats nova_cell1:SELECT=3 {{(pid=105427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:22:10.820768 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG dbcounter [-] [105427] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:22:11.030338 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-9e3e8ce3-afb9-4cec-ac9a-28507f66fcc8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:22:11.100150 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-9e3e8ce3-afb9-4cec-ac9a-28507f66fcc8 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.288676 Sep 30 19:22:11.100787 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 3/6] 10.222.0.17 () {64 vars in 1336 bytes} [Fri Sep 30 19:22:10 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:22:13.684716 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-1c3bd23d-f683-4a3a-a77e-d1545c534aca admin admin] Calling method '>' {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:22:13.685754 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-1c3bd23d-f683-4a3a-a77e-d1545c534aca admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001704 Sep 30 19:22:13.686481 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 4/7] 10.222.0.17 () {54 vars in 931 bytes} [Fri Sep 30 19:22:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:22:14.310192 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-5acc262d-6f15-47c5-8064-d66e34d15773 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 5, "vcpus": 1, "os-flavor-access:is_public": true, "id": "d1", "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "rxtx_factor": 1.0}} {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:22:14.350928 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-5acc262d-6f15-47c5-8064-d66e34d15773 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.657285 Sep 30 19:22:14.351666 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 4/8] 10.222.0.17 () {64 vars in 1283 bytes} [Fri Sep 30 19:22:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 30 19:22:14.364523 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-1b0bee9c-00ae-468b-bbb3-b438c2bd176b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:22:14.413816 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-1b0bee9c-00ae-468b-bbb3-b438c2bd176b admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.053099 Sep 30 19:22:14.420402 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 5/9] 10.222.0.17 () {64 vars in 1336 bytes} [Fri Sep 30 19:22:14 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:22:17.010765 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-5acc262d-6f15-47c5-8064-d66e34d15773 admin admin] Calling method '>' {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:22:17.011784 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-5acc262d-6f15-47c5-8064-d66e34d15773 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Sep 30 19:22:17.012194 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 5/10] 10.222.0.17 () {54 vars in 931 bytes} [Fri Sep 30 19:22:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:22:17.442007 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-00928c91-f192-43ee-9039-8288e3462fc4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 10, "swap": 0, "ram": 1024, "vcpus": 1, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds1G"}} {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:22:17.461834 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-00928c91-f192-43ee-9039-8288e3462fc4 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.442866 Sep 30 19:22:17.462400 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 6/11] 10.222.0.17 () {64 vars in 1283 bytes} [Fri Sep 30 19:22:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 30 19:22:17.474778 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-27c61663-362f-4408-93b0-9e7cccdf5bc8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:22:17.502884 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-27c61663-362f-4408-93b0-9e7cccdf5bc8 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031806 Sep 30 19:22:17.503471 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 6/12] 10.222.0.17 () {64 vars in 1336 bytes} [Fri Sep 30 19:22:17 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:22:20.101765 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-00928c91-f192-43ee-9039-8288e3462fc4 admin admin] Calling method '>' {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:22:20.102990 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-00928c91-f192-43ee-9039-8288e3462fc4 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001657 Sep 30 19:22:20.103503 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 7/13] 10.222.0.17 () {54 vars in 931 bytes} [Fri Sep 30 19:22:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:22:20.518752 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-52e0e260-39eb-4adf-bb6c-b7b037229b16 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 10, "vcpus": 2, "swap": 0}} {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:22:20.540161 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-52e0e260-39eb-4adf-bb6c-b7b037229b16 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.430445 Sep 30 19:22:20.540840 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 7/14] 10.222.0.17 () {64 vars in 1283 bytes} [Fri Sep 30 19:22:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 30 19:22:20.552894 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-3440fc38-d6fd-4978-adf6-2c4c87ba9ceb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:22:20.580200 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-3440fc38-d6fd-4978-adf6-2c4c87ba9ceb admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030935 Sep 30 19:22:20.580808 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 8/15] 10.222.0.17 () {64 vars in 1336 bytes} [Fri Sep 30 19:22:20 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:22:23.303920 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-52e0e260-39eb-4adf-bb6c-b7b037229b16 admin admin] Calling method '>' {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:22:23.305274 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-52e0e260-39eb-4adf-bb6c-b7b037229b16 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001968 Sep 30 19:22:23.305761 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 8/16] 10.222.0.17 () {54 vars in 931 bytes} [Fri Sep 30 19:22:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:22:23.740442 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-fb6b3df3-8045-4cfc-9942-276eefff9423 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 20, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d4", "ram": 4096, "name": "ds4G", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:22:23.760248 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-fb6b3df3-8045-4cfc-9942-276eefff9423 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.446573 Sep 30 19:22:23.760857 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 9/17] 10.222.0.17 () {64 vars in 1283 bytes} [Fri Sep 30 19:22:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 30 19:22:23.775046 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-b067b653-14ae-4d9d-a623-eebb52084979 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:22:23.801522 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-b067b653-14ae-4d9d-a623-eebb52084979 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030064 Sep 30 19:22:23.802093 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 9/18] 10.222.0.17 () {64 vars in 1336 bytes} [Fri Sep 30 19:22:23 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:22:26.977378 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-fb6b3df3-8045-4cfc-9942-276eefff9423 admin admin] Calling method '>' {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:22:26.978395 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-fb6b3df3-8045-4cfc-9942-276eefff9423 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Sep 30 19:22:26.978789 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 10/19] 10.222.0.17 () {54 vars in 931 bytes} [Fri Sep 30 19:22:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 30 19:22:27.406155 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-f5f1873f-ce2b-4534-8bb4-5db0e1e03cb6 admin admin] Calling method '>' {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:22:27.432606 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-f5f1873f-ce2b-4534-8bb4-5db0e1e03cb6 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.447021 Sep 30 19:22:27.433212 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 10/20] 10.222.0.17 () {60 vars in 1292 bytes} [Fri Sep 30 19:22:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:22:30.008719 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-fb6b3df3-8045-4cfc-9942-276eefff9423 admin admin] Calling method '>' {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:22:30.009739 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-fb6b3df3-8045-4cfc-9942-276eefff9423 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Sep 30 19:22:30.010142 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 11/21] 10.222.0.17 () {54 vars in 931 bytes} [Fri Sep 30 19:22:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:22:30.410139 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-a17da268-3891-40cd-bdba-a97c4d4d6627 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "rxtx_factor": 1.0, "swap": 0, "name": "m1.tiny", "ram": 512, "vcpus": 1, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:22:30.430593 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-a17da268-3891-40cd-bdba-a97c4d4d6627 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.414037 Sep 30 19:22:30.431127 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 11/22] 10.222.0.17 () {64 vars in 1283 bytes} [Fri Sep 30 19:22:30 2022] POST /compute/v2.1/flavors => generated 402 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 30 19:22:30.443655 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-83caeb1c-b991-404c-8c82-99cdfb23b0a8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:22:30.471473 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-83caeb1c-b991-404c-8c82-99cdfb23b0a8 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031654 Sep 30 19:22:30.472048 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 12/23] 10.222.0.17 () {64 vars in 1333 bytes} [Fri Sep 30 19:22:30 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:22:33.044442 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-a17da268-3891-40cd-bdba-a97c4d4d6627 admin admin] Calling method '>' {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:22:33.045446 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-a17da268-3891-40cd-bdba-a97c4d4d6627 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Sep 30 19:22:33.045844 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 12/24] 10.222.0.17 () {54 vars in 931 bytes} [Fri Sep 30 19:22:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:22:33.456175 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-db4a7551-6fa1-4795-b39d-beb24747615e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "disk": 20, "id": "2", "vcpus": 1, "ram": 2048}} {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:22:33.477952 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-db4a7551-6fa1-4795-b39d-beb24747615e admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.425862 Sep 30 19:22:33.478644 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 13/25] 10.222.0.17 () {64 vars in 1283 bytes} [Fri Sep 30 19:22:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 30 19:22:33.490722 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-a2c5f82e-3e53-4558-8990-9345fcef1468 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:22:33.515952 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-a2c5f82e-3e53-4558-8990-9345fcef1468 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028759 Sep 30 19:22:33.517339 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 13/26] 10.222.0.17 () {64 vars in 1333 bytes} [Fri Sep 30 19:22:33 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:22:36.211747 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-db4a7551-6fa1-4795-b39d-beb24747615e admin admin] Calling method '>' {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:22:36.212795 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-db4a7551-6fa1-4795-b39d-beb24747615e admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Sep 30 19:22:36.213200 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 14/27] 10.222.0.17 () {54 vars in 931 bytes} [Fri Sep 30 19:22:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:22:36.670939 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-428a63a1-7e48-4dc2-ac62-7bd0d451578b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "vcpus": 2, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "os-flavor-access:is_public": true, "disk": 40, "ram": 4096}} {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:22:36.691422 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-428a63a1-7e48-4dc2-ac62-7bd0d451578b admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.471718 Sep 30 19:22:36.691971 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 14/28] 10.222.0.17 () {64 vars in 1283 bytes} [Fri Sep 30 19:22:36 2022] POST /compute/v2.1/flavors => generated 406 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 30 19:22:36.709149 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-e303cca4-f5bf-43a5-9e56-710660572d8f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:22:36.753013 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-e303cca4-f5bf-43a5-9e56-710660572d8f admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.052605 Sep 30 19:22:36.754062 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 15/29] 10.222.0.17 () {64 vars in 1333 bytes} [Fri Sep 30 19:22:36 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:22:39.338555 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-428a63a1-7e48-4dc2-ac62-7bd0d451578b admin admin] Calling method '>' {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:22:39.339562 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-428a63a1-7e48-4dc2-ac62-7bd0d451578b admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Sep 30 19:22:39.339959 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 15/30] 10.222.0.17 () {54 vars in 931 bytes} [Fri Sep 30 19:22:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:22:39.783139 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-0fee14bb-c14a-49f7-b52e-ab84d8491264 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "ram": 8192, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "4", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 4}} {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:22:39.789447 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG dbcounter [-] [105426] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:22:39.805290 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-0fee14bb-c14a-49f7-b52e-ab84d8491264 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.459093 Sep 30 19:22:39.806243 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 16/31] 10.222.0.17 () {64 vars in 1283 bytes} [Fri Sep 30 19:22:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 30 19:22:39.818527 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-ae237d12-7d31-4c6e-aa6a-fe181a6c3dec admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:22:39.844702 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-ae237d12-7d31-4c6e-aa6a-fe181a6c3dec admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030333 Sep 30 19:22:39.845819 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 16/32] 10.222.0.17 () {64 vars in 1333 bytes} [Fri Sep 30 19:22:39 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:22:42.471635 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-0fee14bb-c14a-49f7-b52e-ab84d8491264 admin admin] Calling method '>' {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:22:42.472165 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-0fee14bb-c14a-49f7-b52e-ab84d8491264 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Sep 30 19:22:42.476059 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 17/33] 10.222.0.17 () {54 vars in 931 bytes} [Fri Sep 30 19:22:42 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:22:42.902895 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-e339a8f7-072e-4500-9a6c-dd2a6af85cda admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "id": "5", "rxtx_factor": 1.0, "name": "m1.xlarge", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "os-flavor-access:is_public": true, "disk": 160}} {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:22:42.915196 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG dbcounter [-] [105427] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:22:42.928416 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-e339a8f7-072e-4500-9a6c-dd2a6af85cda admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.449553 Sep 30 19:22:42.929359 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 17/34] 10.222.0.17 () {64 vars in 1283 bytes} [Fri Sep 30 19:22:42 2022] POST /compute/v2.1/flavors => generated 408 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 30 19:22:42.941772 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-3c5cea65-df97-4ca2-8529-0f3c2016be75 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:22:42.970787 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-3c5cea65-df97-4ca2-8529-0f3c2016be75 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032976 Sep 30 19:22:42.971886 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 18/35] 10.222.0.17 () {64 vars in 1333 bytes} [Fri Sep 30 19:22:42 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:22:59.260963 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-e339a8f7-072e-4500-9a6c-dd2a6af85cda admin admin] Calling method '>' {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:22:59.261960 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-e339a8f7-072e-4500-9a6c-dd2a6af85cda admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Sep 30 19:22:59.262360 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 18/36] 10.222.0.17 () {54 vars in 931 bytes} [Fri Sep 30 19:22:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:22:59.272683 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG dbcounter [-] [105426] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:22:59.760453 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-6a1df075-1454-4f27-a8a1-4f442fb92d16 admin admin] Calling method '>' {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:22:59.778862 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-6a1df075-1454-4f27-a8a1-4f442fb92d16 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.510174 Sep 30 19:22:59.779395 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 19/37] 10.222.0.17 () {60 vars in 1292 bytes} [Fri Sep 30 19:22:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:23:01.072111 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-e339a8f7-072e-4500-9a6c-dd2a6af85cda admin admin] Calling method '>' {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:23:01.073139 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-e339a8f7-072e-4500-9a6c-dd2a6af85cda admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Sep 30 19:23:01.073539 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 19/38] 10.222.0.17 () {56 vars in 1074 bytes} [Fri Sep 30 19:23:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:23:01.586183 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-2fe04a50-47d4-42ad-9ced-20ded62e39f5 admin admin] Calling method '>' {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:23:01.592096 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.wsgi [None req-2fe04a50-47d4-42ad-9ced-20ded62e39f5 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 30 19:23:01.595418 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-2fe04a50-47d4-42ad-9ced-20ded62e39f5 admin admin] Request method failure captured: Sep 30 19:23:01.595418 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 30 19:23:01.595418 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: Accept: application/json Sep 30 19:23:01.595418 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: Accept-Encoding: gzip, deflate Sep 30 19:23:01.595418 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: Connection: keep-alive Sep 30 19:23:01.595418 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: Content-Length: 0 Sep 30 19:23:01.595418 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: Host: 10.222.0.17 Sep 30 19:23:01.595418 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: Openstack-Api-Version: compute 2.92 Sep 30 19:23:01.595418 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: Openstack-System-Scope: None Sep 30 19:23:01.595418 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: User-Agent: python-novaclient Sep 30 19:23:01.595418 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-Auth-Token: gAAAAABjN0IUtv7EG6RgNG0SMZFBHCUlgPWGZLs-E0-8aZMxUKbsQImN-sAS89tMYLBpXZoCrVx2gPofW6VicrXTsGMcsmvU2SwPDlK2EScCP6K2dtNbobFrsgrHhVcvSeC-9uBpv-8-iIjNTsP5i-wlthaHB_W9v95OP0pl3LZc0iCFdfO5UTo Sep 30 19:23:01.595418 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-Domain-Id: None Sep 30 19:23:01.595418 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-Domain-Name: None Sep 30 19:23:01.595418 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-Identity-Status: Confirmed Sep 30 19:23:01.595418 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-Is-Admin-Project: True Sep 30 19:23:01.595418 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-Openstack-Nova-Api-Version: 2.92 Sep 30 19:23:01.595418 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-Project-Domain-Id: default Sep 30 19:23:01.595418 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-Project-Domain-Name: Default Sep 30 19:23:01.595418 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-Project-Id: e574e273dabe4a3eab67dc95d42fcb6b Sep 30 19:23:01.595418 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-Project-Name: admin Sep 30 19:23:01.595418 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-Role: admin,member,reader Sep 30 19:23:01.595418 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-Roles: admin,member,reader Sep 30 19:23:01.597190 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e574e273dabe4a3eab67dc95d42fcb6b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e574e273dabe4a3eab67dc95d42fcb6b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e574e273dabe4a3eab67dc95d42fcb6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e574e273dabe4a3eab67dc95d42fcb6b"}]}] Sep 30 19:23:01.597190 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-Tenant: admin Sep 30 19:23:01.597190 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-Tenant-Id: e574e273dabe4a3eab67dc95d42fcb6b Sep 30 19:23:01.597190 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-Tenant-Name: admin Sep 30 19:23:01.597190 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-User: admin Sep 30 19:23:01.597190 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-User-Domain-Id: default Sep 30 19:23:01.597190 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-User-Domain-Name: Default Sep 30 19:23:01.597190 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-User-Id: 02c8dc74a8e74fac884b7eaf15083780 Sep 30 19:23:01.597190 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-User-Name: admin Sep 30 19:23:01.597190 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: method: > Sep 30 19:23:01.597190 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: exception: Flavor 42 could not be found. Sep 30 19:23:01.597190 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: action_args: {'id': '42'} Sep 30 19:23:01.597190 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:23:01.597190 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:23:01.598097 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 30 19:23:01.598097 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 30 19:23:01.598097 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 30 19:23:01.598097 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 30 19:23:01.598097 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 30 19:23:01.598097 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 30 19:23:01.598097 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 30 19:23:01.598097 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 30 19:23:01.598097 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 30 19:23:01.598097 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:23:01.598097 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 30 19:23:01.598097 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 30 19:23:01.598097 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 30 19:23:01.598097 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi Sep 30 19:23:01.598097 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:23:01.598097 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi Sep 30 19:23:01.598097 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:23:01.598097 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:23:01.598097 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:23:01.599451 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:23:01.599451 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:23:01.599451 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:23:01.599451 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:23:01.599451 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 30 19:23:01.599451 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 30 19:23:01.599451 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 30 19:23:01.599451 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi Sep 30 19:23:01.599451 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:23:01.599451 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi Sep 30 19:23:01.599451 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:23:01.599451 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:23:01.599451 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:23:01.599451 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:23:01.599451 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:23:01.599451 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 30 19:23:01.599451 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi Sep 30 19:23:01.599451 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-2fe04a50-47d4-42ad-9ced-20ded62e39f5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:23:01.600812 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-2fe04a50-47d4-42ad-9ced-20ded62e39f5 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.388269 Sep 30 19:23:01.600812 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 20/39] 10.222.0.17 () {60 vars in 1190 bytes} [Fri Sep 30 19:23:01 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 30 19:23:01.606672 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-232fe5d0-21d5-4e46-b7bc-d8617067e067 admin admin] Calling method '>' {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:23:01.629393 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-232fe5d0-21d5-4e46-b7bc-d8617067e067 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026375 Sep 30 19:23:01.629938 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 20/40] 10.222.0.17 () {60 vars in 1210 bytes} [Fri Sep 30 19:23:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:23:01.641070 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-5f03bddd-4f9a-4053-a540-a88bfd7fe523 admin admin] Calling method '>' {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:23:01.663143 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-5f03bddd-4f9a-4053-a540-a88bfd7fe523 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027182 Sep 30 19:23:01.663956 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 21/41] 10.222.0.17 () {60 vars in 1210 bytes} [Fri Sep 30 19:23:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:23:01.673515 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-09df3549-1bf4-4fd1-aa9f-1e6008694fe5 admin admin] Calling method '>' {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:23:01.678821 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.wsgi [None req-09df3549-1bf4-4fd1-aa9f-1e6008694fe5 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 30 19:23:01.682133 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-09df3549-1bf4-4fd1-aa9f-1e6008694fe5 admin admin] Request method failure captured: Sep 30 19:23:01.682133 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 30 19:23:01.682133 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: Accept: application/json Sep 30 19:23:01.682133 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: Accept-Encoding: gzip, deflate Sep 30 19:23:01.682133 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: Connection: keep-alive Sep 30 19:23:01.682133 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: Content-Length: 0 Sep 30 19:23:01.682133 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: Host: 10.222.0.17 Sep 30 19:23:01.682133 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: Openstack-Api-Version: compute 2.92 Sep 30 19:23:01.682133 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: Openstack-System-Scope: None Sep 30 19:23:01.682133 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: User-Agent: python-novaclient Sep 30 19:23:01.682133 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-Auth-Token: gAAAAABjN0IUtv7EG6RgNG0SMZFBHCUlgPWGZLs-E0-8aZMxUKbsQImN-sAS89tMYLBpXZoCrVx2gPofW6VicrXTsGMcsmvU2SwPDlK2EScCP6K2dtNbobFrsgrHhVcvSeC-9uBpv-8-iIjNTsP5i-wlthaHB_W9v95OP0pl3LZc0iCFdfO5UTo Sep 30 19:23:01.682133 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-Domain-Id: None Sep 30 19:23:01.682133 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-Domain-Name: None Sep 30 19:23:01.682133 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-Identity-Status: Confirmed Sep 30 19:23:01.682133 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-Is-Admin-Project: True Sep 30 19:23:01.682133 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-Openstack-Nova-Api-Version: 2.92 Sep 30 19:23:01.682133 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-Project-Domain-Id: default Sep 30 19:23:01.682133 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-Project-Domain-Name: Default Sep 30 19:23:01.682133 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-Project-Id: e574e273dabe4a3eab67dc95d42fcb6b Sep 30 19:23:01.682133 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-Project-Name: admin Sep 30 19:23:01.682133 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-Role: admin,member,reader Sep 30 19:23:01.682133 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-Roles: admin,member,reader Sep 30 19:23:01.683687 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e574e273dabe4a3eab67dc95d42fcb6b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e574e273dabe4a3eab67dc95d42fcb6b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e574e273dabe4a3eab67dc95d42fcb6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e574e273dabe4a3eab67dc95d42fcb6b"}]}] Sep 30 19:23:01.683687 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-Tenant: admin Sep 30 19:23:01.683687 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-Tenant-Id: e574e273dabe4a3eab67dc95d42fcb6b Sep 30 19:23:01.683687 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-Tenant-Name: admin Sep 30 19:23:01.683687 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-User: admin Sep 30 19:23:01.683687 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-User-Domain-Id: default Sep 30 19:23:01.683687 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-User-Domain-Name: Default Sep 30 19:23:01.683687 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-User-Id: 02c8dc74a8e74fac884b7eaf15083780 Sep 30 19:23:01.683687 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-User-Name: admin Sep 30 19:23:01.683687 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: method: > Sep 30 19:23:01.683687 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: exception: Flavor 42 could not be found. Sep 30 19:23:01.683687 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: action_args: {'id': '42'} Sep 30 19:23:01.683687 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:23:01.683687 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:23:01.684665 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 30 19:23:01.684665 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 30 19:23:01.684665 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 30 19:23:01.684665 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 30 19:23:01.684665 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 30 19:23:01.684665 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 30 19:23:01.684665 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 30 19:23:01.684665 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 30 19:23:01.684665 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 30 19:23:01.684665 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:23:01.684665 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 30 19:23:01.684665 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 30 19:23:01.684665 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 30 19:23:01.684665 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi Sep 30 19:23:01.684665 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:23:01.684665 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi Sep 30 19:23:01.684665 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:23:01.684665 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:23:01.684665 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:23:01.686103 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:23:01.686103 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:23:01.686103 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:23:01.686103 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:23:01.686103 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 30 19:23:01.686103 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 30 19:23:01.686103 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 30 19:23:01.686103 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi Sep 30 19:23:01.686103 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:23:01.686103 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi Sep 30 19:23:01.686103 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:23:01.686103 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:23:01.686103 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:23:01.686103 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:23:01.686103 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:23:01.686103 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 30 19:23:01.686103 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi Sep 30 19:23:01.686103 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-09df3549-1bf4-4fd1-aa9f-1e6008694fe5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105427) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:23:01.687347 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-09df3549-1bf4-4fd1-aa9f-1e6008694fe5 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013802 Sep 30 19:23:01.687347 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 21/42] 10.222.0.17 () {60 vars in 1190 bytes} [Fri Sep 30 19:23:01 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 30 19:23:03.013497 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-5f03bddd-4f9a-4053-a540-a88bfd7fe523 admin admin] Calling method '>' {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:23:03.014499 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-5f03bddd-4f9a-4053-a540-a88bfd7fe523 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Sep 30 19:23:03.014896 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 22/43] 10.222.0.17 () {56 vars in 1074 bytes} [Fri Sep 30 19:23:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:23:03.523582 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-953bdcf3-822f-48cd-b230-9be82daa8aa3 admin admin] Calling method '>' {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:23:03.529284 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.wsgi [None req-953bdcf3-822f-48cd-b230-9be82daa8aa3 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 30 19:23:03.530885 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-953bdcf3-822f-48cd-b230-9be82daa8aa3 admin admin] Request method failure captured: Sep 30 19:23:03.530885 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 30 19:23:03.530885 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: Accept: application/json Sep 30 19:23:03.530885 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: Accept-Encoding: gzip, deflate Sep 30 19:23:03.530885 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: Connection: keep-alive Sep 30 19:23:03.530885 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: Content-Length: 0 Sep 30 19:23:03.530885 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: Host: 10.222.0.17 Sep 30 19:23:03.530885 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: Openstack-Api-Version: compute 2.92 Sep 30 19:23:03.530885 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: Openstack-System-Scope: None Sep 30 19:23:03.530885 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: User-Agent: python-novaclient Sep 30 19:23:03.530885 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-Auth-Token: gAAAAABjN0IWyYTpE2tLA_smrTlujkyysbl5tih235--lPpWEYWjBw2Z5AXnMsOJ54oQVXfO0Gvb6tCetW7rt1ukK8lJH_X3MqmCkQXn_t9uDMFtf2573Xs9pLgGvqk-fTJtBG0T0BOW_Rzx1VAkF0N_Yj-aIgT6-e6Wmul-EgjbvEKnaiErP34 Sep 30 19:23:03.530885 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-Domain-Id: None Sep 30 19:23:03.530885 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-Domain-Name: None Sep 30 19:23:03.530885 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-Identity-Status: Confirmed Sep 30 19:23:03.530885 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-Is-Admin-Project: True Sep 30 19:23:03.530885 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-Openstack-Nova-Api-Version: 2.92 Sep 30 19:23:03.530885 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-Project-Domain-Id: default Sep 30 19:23:03.530885 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-Project-Domain-Name: Default Sep 30 19:23:03.530885 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-Project-Id: e574e273dabe4a3eab67dc95d42fcb6b Sep 30 19:23:03.530885 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-Project-Name: admin Sep 30 19:23:03.530885 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-Role: admin,member,reader Sep 30 19:23:03.530885 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-Roles: admin,member,reader Sep 30 19:23:03.532467 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e574e273dabe4a3eab67dc95d42fcb6b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e574e273dabe4a3eab67dc95d42fcb6b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e574e273dabe4a3eab67dc95d42fcb6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e574e273dabe4a3eab67dc95d42fcb6b"}]}] Sep 30 19:23:03.532467 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-Tenant: admin Sep 30 19:23:03.532467 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-Tenant-Id: e574e273dabe4a3eab67dc95d42fcb6b Sep 30 19:23:03.532467 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-Tenant-Name: admin Sep 30 19:23:03.532467 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-User: admin Sep 30 19:23:03.532467 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-User-Domain-Id: default Sep 30 19:23:03.532467 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-User-Domain-Name: Default Sep 30 19:23:03.532467 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-User-Id: 02c8dc74a8e74fac884b7eaf15083780 Sep 30 19:23:03.532467 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-User-Name: admin Sep 30 19:23:03.532467 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: method: > Sep 30 19:23:03.532467 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: exception: Flavor 84 could not be found. Sep 30 19:23:03.532467 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: action_args: {'id': '84'} Sep 30 19:23:03.532467 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:23:03.532467 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:23:03.533450 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 30 19:23:03.533450 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 30 19:23:03.533450 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 30 19:23:03.533450 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 30 19:23:03.533450 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 30 19:23:03.533450 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 30 19:23:03.533450 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 30 19:23:03.533450 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 30 19:23:03.533450 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 30 19:23:03.533450 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:23:03.533450 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 30 19:23:03.533450 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 30 19:23:03.533450 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 30 19:23:03.533450 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi Sep 30 19:23:03.533450 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:23:03.533450 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi Sep 30 19:23:03.533450 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:23:03.533450 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:23:03.533450 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:23:03.534900 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:23:03.534900 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:23:03.534900 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:23:03.534900 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:23:03.534900 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 30 19:23:03.534900 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 30 19:23:03.534900 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 30 19:23:03.534900 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi Sep 30 19:23:03.534900 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:23:03.534900 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi Sep 30 19:23:03.534900 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:23:03.534900 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:23:03.534900 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:23:03.534900 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:23:03.534900 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:23:03.534900 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 30 19:23:03.534900 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi Sep 30 19:23:03.534900 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-953bdcf3-822f-48cd-b230-9be82daa8aa3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105427) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:23:03.536179 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-953bdcf3-822f-48cd-b230-9be82daa8aa3 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.380557 Sep 30 19:23:03.536179 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 22/44] 10.222.0.17 () {60 vars in 1190 bytes} [Fri Sep 30 19:23:03 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 382 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 30 19:23:03.542294 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-5118fa1c-9967-452e-a924-ad941252eb85 admin admin] Calling method '>' {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:23:03.557625 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-5118fa1c-9967-452e-a924-ad941252eb85 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019107 Sep 30 19:23:03.558087 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 23/45] 10.222.0.17 () {60 vars in 1210 bytes} [Fri Sep 30 19:23:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:23:03.567259 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-4f588ce2-353f-4da6-8c2a-24b0827fe9e8 admin admin] Calling method '>' {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:23:03.582349 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-4f588ce2-353f-4da6-8c2a-24b0827fe9e8 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018559 Sep 30 19:23:03.582868 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 23/46] 10.222.0.17 () {60 vars in 1210 bytes} [Fri Sep 30 19:23:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:23:03.592414 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-cb8d2e3a-653d-462c-a4f7-7dc77068798d admin admin] Calling method '>' {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:23:03.597440 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.wsgi [None req-cb8d2e3a-653d-462c-a4f7-7dc77068798d admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 30 19:23:03.598952 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-cb8d2e3a-653d-462c-a4f7-7dc77068798d admin admin] Request method failure captured: Sep 30 19:23:03.598952 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 30 19:23:03.598952 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: Accept: application/json Sep 30 19:23:03.598952 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: Accept-Encoding: gzip, deflate Sep 30 19:23:03.598952 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: Connection: keep-alive Sep 30 19:23:03.598952 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: Content-Length: 0 Sep 30 19:23:03.598952 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: Host: 10.222.0.17 Sep 30 19:23:03.598952 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: Openstack-Api-Version: compute 2.92 Sep 30 19:23:03.598952 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: Openstack-System-Scope: None Sep 30 19:23:03.598952 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: User-Agent: python-novaclient Sep 30 19:23:03.598952 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-Auth-Token: gAAAAABjN0IWyYTpE2tLA_smrTlujkyysbl5tih235--lPpWEYWjBw2Z5AXnMsOJ54oQVXfO0Gvb6tCetW7rt1ukK8lJH_X3MqmCkQXn_t9uDMFtf2573Xs9pLgGvqk-fTJtBG0T0BOW_Rzx1VAkF0N_Yj-aIgT6-e6Wmul-EgjbvEKnaiErP34 Sep 30 19:23:03.598952 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-Domain-Id: None Sep 30 19:23:03.598952 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-Domain-Name: None Sep 30 19:23:03.598952 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-Identity-Status: Confirmed Sep 30 19:23:03.598952 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-Is-Admin-Project: True Sep 30 19:23:03.598952 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-Openstack-Nova-Api-Version: 2.92 Sep 30 19:23:03.598952 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-Project-Domain-Id: default Sep 30 19:23:03.598952 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-Project-Domain-Name: Default Sep 30 19:23:03.598952 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-Project-Id: e574e273dabe4a3eab67dc95d42fcb6b Sep 30 19:23:03.598952 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-Project-Name: admin Sep 30 19:23:03.598952 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-Role: admin,member,reader Sep 30 19:23:03.598952 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-Roles: admin,member,reader Sep 30 19:23:03.600557 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e574e273dabe4a3eab67dc95d42fcb6b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e574e273dabe4a3eab67dc95d42fcb6b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e574e273dabe4a3eab67dc95d42fcb6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e574e273dabe4a3eab67dc95d42fcb6b"}]}] Sep 30 19:23:03.600557 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-Tenant: admin Sep 30 19:23:03.600557 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-Tenant-Id: e574e273dabe4a3eab67dc95d42fcb6b Sep 30 19:23:03.600557 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-Tenant-Name: admin Sep 30 19:23:03.600557 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-User: admin Sep 30 19:23:03.600557 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-User-Domain-Id: default Sep 30 19:23:03.600557 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-User-Domain-Name: Default Sep 30 19:23:03.600557 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-User-Id: 02c8dc74a8e74fac884b7eaf15083780 Sep 30 19:23:03.600557 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-User-Name: admin Sep 30 19:23:03.600557 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: method: > Sep 30 19:23:03.600557 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: exception: Flavor 84 could not be found. Sep 30 19:23:03.600557 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: action_args: {'id': '84'} Sep 30 19:23:03.600557 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:23:03.600557 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:23:03.601626 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 30 19:23:03.601626 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 30 19:23:03.601626 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 30 19:23:03.601626 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 30 19:23:03.601626 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 30 19:23:03.601626 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 30 19:23:03.601626 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 30 19:23:03.601626 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 30 19:23:03.601626 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 30 19:23:03.601626 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:23:03.601626 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 30 19:23:03.601626 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 30 19:23:03.601626 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 30 19:23:03.601626 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi Sep 30 19:23:03.601626 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:23:03.601626 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi Sep 30 19:23:03.601626 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:23:03.601626 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:23:03.601626 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:23:03.602762 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:23:03.602762 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:23:03.602762 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:23:03.602762 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:23:03.602762 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 30 19:23:03.602762 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 30 19:23:03.602762 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 30 19:23:03.602762 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi Sep 30 19:23:03.602762 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:23:03.602762 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi Sep 30 19:23:03.602762 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:23:03.602762 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:23:03.602762 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:23:03.602762 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:23:03.602762 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:23:03.602762 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 30 19:23:03.602762 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi Sep 30 19:23:03.602762 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-cb8d2e3a-653d-462c-a4f7-7dc77068798d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:23:03.603803 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-cb8d2e3a-653d-462c-a4f7-7dc77068798d admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011940 Sep 30 19:23:03.603803 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 24/47] 10.222.0.17 () {60 vars in 1190 bytes} [Fri Sep 30 19:23:03 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 30 19:23:04.798416 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-4f588ce2-353f-4da6-8c2a-24b0827fe9e8 admin admin] Calling method '>' {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:23:04.799414 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-4f588ce2-353f-4da6-8c2a-24b0827fe9e8 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Sep 30 19:23:04.799803 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 24/48] 10.222.0.17 () {56 vars in 1074 bytes} [Fri Sep 30 19:23:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:23:05.308442 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-9e918cdc-368f-441f-83af-b18116d688cc admin admin] Calling method '>' {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:23:05.314818 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.wsgi [None req-9e918cdc-368f-441f-83af-b18116d688cc admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 30 19:23:05.316301 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-9e918cdc-368f-441f-83af-b18116d688cc admin admin] Request method failure captured: Sep 30 19:23:05.316301 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 30 19:23:05.316301 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: Accept: application/json Sep 30 19:23:05.316301 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: Accept-Encoding: gzip, deflate Sep 30 19:23:05.316301 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: Connection: keep-alive Sep 30 19:23:05.316301 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: Content-Length: 0 Sep 30 19:23:05.316301 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: Host: 10.222.0.17 Sep 30 19:23:05.316301 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: Openstack-Api-Version: compute 2.92 Sep 30 19:23:05.316301 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: Openstack-System-Scope: None Sep 30 19:23:05.316301 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: User-Agent: python-novaclient Sep 30 19:23:05.316301 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-Auth-Token: gAAAAABjN0IYKjPUzUrH7xnKF9LkUSqthhODCSS_SO-mdUvDOgO1Z29C_8H5jGJFUogkmUleU38H0Q6aslAWLbfrN3X9FCpgVhbcYvcRCGWjh39E3VvEvViOdyE-wkvSJqubcYTSnKwgHwpChJ0R2Img5eM4T4jahz83F4FEg1UcnkREJfbolnE Sep 30 19:23:05.316301 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-Domain-Id: None Sep 30 19:23:05.316301 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-Domain-Name: None Sep 30 19:23:05.316301 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-Identity-Status: Confirmed Sep 30 19:23:05.316301 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-Is-Admin-Project: True Sep 30 19:23:05.316301 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-Openstack-Nova-Api-Version: 2.92 Sep 30 19:23:05.316301 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-Project-Domain-Id: default Sep 30 19:23:05.316301 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-Project-Domain-Name: Default Sep 30 19:23:05.316301 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-Project-Id: e574e273dabe4a3eab67dc95d42fcb6b Sep 30 19:23:05.316301 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-Project-Name: admin Sep 30 19:23:05.316301 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-Role: admin,member,reader Sep 30 19:23:05.316301 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-Roles: admin,member,reader Sep 30 19:23:05.317860 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e574e273dabe4a3eab67dc95d42fcb6b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e574e273dabe4a3eab67dc95d42fcb6b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e574e273dabe4a3eab67dc95d42fcb6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e574e273dabe4a3eab67dc95d42fcb6b"}]}] Sep 30 19:23:05.317860 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-Tenant: admin Sep 30 19:23:05.317860 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-Tenant-Id: e574e273dabe4a3eab67dc95d42fcb6b Sep 30 19:23:05.317860 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-Tenant-Name: admin Sep 30 19:23:05.317860 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-User: admin Sep 30 19:23:05.317860 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-User-Domain-Id: default Sep 30 19:23:05.317860 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-User-Domain-Name: Default Sep 30 19:23:05.317860 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-User-Id: 02c8dc74a8e74fac884b7eaf15083780 Sep 30 19:23:05.317860 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: X-User-Name: admin Sep 30 19:23:05.317860 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: method: > Sep 30 19:23:05.317860 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: exception: Flavor 451 could not be found. Sep 30 19:23:05.317860 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: action_args: {'id': '451'} Sep 30 19:23:05.317860 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:23:05.317860 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:23:05.318931 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 30 19:23:05.318931 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 30 19:23:05.318931 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 30 19:23:05.318931 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 30 19:23:05.318931 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 30 19:23:05.318931 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 30 19:23:05.318931 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 30 19:23:05.318931 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 30 19:23:05.318931 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 30 19:23:05.318931 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:23:05.318931 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 30 19:23:05.318931 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 30 19:23:05.318931 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 30 19:23:05.318931 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi Sep 30 19:23:05.318931 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:23:05.318931 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi Sep 30 19:23:05.318931 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:23:05.318931 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:23:05.318931 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:23:05.320312 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:23:05.320312 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:23:05.320312 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:23:05.320312 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:23:05.320312 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 30 19:23:05.320312 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 30 19:23:05.320312 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 30 19:23:05.320312 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi Sep 30 19:23:05.320312 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:23:05.320312 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi Sep 30 19:23:05.320312 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:23:05.320312 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:23:05.320312 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:23:05.320312 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:23:05.320312 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:23:05.320312 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 30 19:23:05.320312 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi Sep 30 19:23:05.320312 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-9e918cdc-368f-441f-83af-b18116d688cc admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:23:05.321689 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-9e918cdc-368f-441f-83af-b18116d688cc admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.382703 Sep 30 19:23:05.321689 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 25/49] 10.222.0.17 () {60 vars in 1193 bytes} [Fri Sep 30 19:23:04 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 384 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 30 19:23:05.327315 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-51721a08-28b7-4536-91a8-90bc73207953 admin admin] Calling method '>' {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:23:05.341910 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-51721a08-28b7-4536-91a8-90bc73207953 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018079 Sep 30 19:23:05.342425 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 25/50] 10.222.0.17 () {60 vars in 1210 bytes} [Fri Sep 30 19:23:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:23:05.351533 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-7d5496da-81ca-43bd-b152-b7298cb7eb3f admin admin] Calling method '>' {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:23:05.366615 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-7d5496da-81ca-43bd-b152-b7298cb7eb3f admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018544 Sep 30 19:23:05.367140 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 26/51] 10.222.0.17 () {60 vars in 1210 bytes} [Fri Sep 30 19:23:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:23:05.376266 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-f92f982d-fb55-4241-aebe-0692bbd8dccf admin admin] Calling method '>' {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:23:05.381238 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.wsgi [None req-f92f982d-fb55-4241-aebe-0692bbd8dccf admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 30 19:23:05.382729 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-f92f982d-fb55-4241-aebe-0692bbd8dccf admin admin] Request method failure captured: Sep 30 19:23:05.382729 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 30 19:23:05.382729 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: Accept: application/json Sep 30 19:23:05.382729 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: Accept-Encoding: gzip, deflate Sep 30 19:23:05.382729 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: Connection: keep-alive Sep 30 19:23:05.382729 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: Content-Length: 0 Sep 30 19:23:05.382729 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: Host: 10.222.0.17 Sep 30 19:23:05.382729 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: Openstack-Api-Version: compute 2.92 Sep 30 19:23:05.382729 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: Openstack-System-Scope: None Sep 30 19:23:05.382729 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: User-Agent: python-novaclient Sep 30 19:23:05.382729 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-Auth-Token: gAAAAABjN0IYKjPUzUrH7xnKF9LkUSqthhODCSS_SO-mdUvDOgO1Z29C_8H5jGJFUogkmUleU38H0Q6aslAWLbfrN3X9FCpgVhbcYvcRCGWjh39E3VvEvViOdyE-wkvSJqubcYTSnKwgHwpChJ0R2Img5eM4T4jahz83F4FEg1UcnkREJfbolnE Sep 30 19:23:05.382729 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-Domain-Id: None Sep 30 19:23:05.382729 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-Domain-Name: None Sep 30 19:23:05.382729 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-Identity-Status: Confirmed Sep 30 19:23:05.382729 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-Is-Admin-Project: True Sep 30 19:23:05.382729 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-Openstack-Nova-Api-Version: 2.92 Sep 30 19:23:05.382729 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-Project-Domain-Id: default Sep 30 19:23:05.382729 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-Project-Domain-Name: Default Sep 30 19:23:05.382729 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-Project-Id: e574e273dabe4a3eab67dc95d42fcb6b Sep 30 19:23:05.382729 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-Project-Name: admin Sep 30 19:23:05.382729 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-Role: admin,member,reader Sep 30 19:23:05.382729 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-Roles: admin,member,reader Sep 30 19:23:05.384234 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e574e273dabe4a3eab67dc95d42fcb6b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e574e273dabe4a3eab67dc95d42fcb6b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e574e273dabe4a3eab67dc95d42fcb6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e574e273dabe4a3eab67dc95d42fcb6b"}]}] Sep 30 19:23:05.384234 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-Tenant: admin Sep 30 19:23:05.384234 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-Tenant-Id: e574e273dabe4a3eab67dc95d42fcb6b Sep 30 19:23:05.384234 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-Tenant-Name: admin Sep 30 19:23:05.384234 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-User: admin Sep 30 19:23:05.384234 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-User-Domain-Id: default Sep 30 19:23:05.384234 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-User-Domain-Name: Default Sep 30 19:23:05.384234 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-User-Id: 02c8dc74a8e74fac884b7eaf15083780 Sep 30 19:23:05.384234 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: X-User-Name: admin Sep 30 19:23:05.384234 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: method: > Sep 30 19:23:05.384234 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: exception: Flavor 451 could not be found. Sep 30 19:23:05.384234 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: action_args: {'id': '451'} Sep 30 19:23:05.384234 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:23:05.384234 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:23:05.385114 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 30 19:23:05.385114 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 30 19:23:05.385114 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 30 19:23:05.385114 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 30 19:23:05.385114 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 30 19:23:05.385114 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 30 19:23:05.385114 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 30 19:23:05.385114 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 30 19:23:05.385114 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 30 19:23:05.385114 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:23:05.385114 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 30 19:23:05.385114 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 30 19:23:05.385114 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 30 19:23:05.385114 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi Sep 30 19:23:05.385114 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:23:05.385114 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi Sep 30 19:23:05.385114 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:23:05.385114 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:23:05.385114 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:23:05.386215 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:23:05.386215 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:23:05.386215 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:23:05.386215 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:23:05.386215 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 30 19:23:05.386215 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 30 19:23:05.386215 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 30 19:23:05.386215 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi Sep 30 19:23:05.386215 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:23:05.386215 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi Sep 30 19:23:05.386215 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:23:05.386215 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:23:05.386215 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:23:05.386215 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:23:05.386215 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:23:05.386215 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 30 19:23:05.386215 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi Sep 30 19:23:05.386215 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-f92f982d-fb55-4241-aebe-0692bbd8dccf admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105427) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:23:05.387743 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-f92f982d-fb55-4241-aebe-0692bbd8dccf admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011369 Sep 30 19:23:05.387743 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 26/52] 10.222.0.17 () {60 vars in 1193 bytes} [Fri Sep 30 19:23:05 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 30 19:23:06.585557 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-7d5496da-81ca-43bd-b152-b7298cb7eb3f admin admin] Calling method '>' {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:23:06.586590 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-7d5496da-81ca-43bd-b152-b7298cb7eb3f admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Sep 30 19:23:06.586981 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 27/53] 10.222.0.17 () {56 vars in 1074 bytes} [Fri Sep 30 19:23:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:23:07.105635 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-2264a640-74b3-4bc8-8dea-dbab6ba79516 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:23:07.125188 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-2264a640-74b3-4bc8-8dea-dbab6ba79516 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.400867 Sep 30 19:23:07.125742 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 27/54] 10.222.0.17 () {64 vars in 1235 bytes} [Fri Sep 30 19:23:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 30 19:23:08.326524 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-7d5496da-81ca-43bd-b152-b7298cb7eb3f admin admin] Calling method '>' {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:23:08.327519 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-7d5496da-81ca-43bd-b152-b7298cb7eb3f admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 Sep 30 19:23:08.327912 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 28/55] 10.222.0.17 () {56 vars in 1074 bytes} [Fri Sep 30 19:23:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:23:08.841360 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-949c9b9b-f663-4459-b3cc-7117130a6ff7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:23:08.859739 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-949c9b9b-f663-4459-b3cc-7117130a6ff7 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.393174 Sep 30 19:23:08.860482 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 28/56] 10.222.0.17 () {64 vars in 1235 bytes} [Fri Sep 30 19:23:08 2022] POST /compute/v2.1/flavors => generated 405 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 30 19:23:10.067864 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-7d5496da-81ca-43bd-b152-b7298cb7eb3f admin admin] Calling method '>' {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:23:10.068926 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-7d5496da-81ca-43bd-b152-b7298cb7eb3f admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Sep 30 19:23:10.069321 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 29/57] 10.222.0.17 () {56 vars in 1074 bytes} [Fri Sep 30 19:23:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:23:10.580151 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-7db38d81-300a-43ff-bef7-938437b1ddd0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:23:10.599220 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-7db38d81-300a-43ff-bef7-938437b1ddd0 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.393893 Sep 30 19:23:10.599767 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 29/58] 10.222.0.17 () {64 vars in 1235 bytes} [Fri Sep 30 19:23:10 2022] POST /compute/v2.1/flavors => generated 407 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 30 19:23:11.804876 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-7d5496da-81ca-43bd-b152-b7298cb7eb3f admin admin] Calling method '>' {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:23:11.805912 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-7d5496da-81ca-43bd-b152-b7298cb7eb3f admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Sep 30 19:23:11.806304 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 30/59] 10.222.0.17 () {56 vars in 1074 bytes} [Fri Sep 30 19:23:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:23:12.321199 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-b4d7b65e-1326-4eff-b517-928cbec1ad0b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:23:12.341990 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-b4d7b65e-1326-4eff-b517-928cbec1ad0b admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.397427 Sep 30 19:23:12.342633 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 30/60] 10.222.0.17 () {64 vars in 1235 bytes} [Fri Sep 30 19:23:11 2022] POST /compute/v2.1/flavors => generated 409 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 30 19:23:13.552726 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-7d5496da-81ca-43bd-b152-b7298cb7eb3f admin admin] Calling method '>' {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:23:13.553713 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-7d5496da-81ca-43bd-b152-b7298cb7eb3f admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Sep 30 19:23:13.554104 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 31/61] 10.222.0.17 () {56 vars in 1074 bytes} [Fri Sep 30 19:23:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:23:14.060976 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-eaab9f02-df0b-47f1-90c3-0e3075ed1a53 admin admin] Calling method '>' {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:23:14.081367 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-eaab9f02-df0b-47f1-90c3-0e3075ed1a53 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.391965 Sep 30 19:23:14.081900 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 31/62] 10.222.0.17 () {60 vars in 1202 bytes} [Fri Sep 30 19:23:13 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:24:10.051566 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-7d5496da-81ca-43bd-b152-b7298cb7eb3f admin admin] Calling method '>' {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:24:10.052621 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-7d5496da-81ca-43bd-b152-b7298cb7eb3f admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Sep 30 19:24:10.053026 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 32/63] 10.222.0.17 () {54 vars in 931 bytes} [Fri Sep 30 19:24:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:24:10.064228 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG dbcounter [-] [105427] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:24:10.435605 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-e5227d26-aefd-4217-bb2f-7e867d2727bc admin admin] Calling method '>' {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:24:10.456045 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-e5227d26-aefd-4217-bb2f-7e867d2727bc admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.396245 Sep 30 19:24:10.456728 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 32/64] 10.222.0.17 () {60 vars in 1292 bytes} [Fri Sep 30 19:24:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:24:10.477286 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG dbcounter [-] [105426] Writing DB stats nova_api:SELECT=14 {{(pid=105426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:24:10.481530 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-4c808791-d8f7-4371-93bc-4fe0e07ea738 admin admin] Calling method '>' {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:24:10.488852 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-4c808791-d8f7-4371-93bc-4fe0e07ea738 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013078 Sep 30 19:24:10.489368 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 33/65] 10.222.0.17 () {60 vars in 1283 bytes} [Fri Sep 30 19:24:10 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:24:10.501363 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-b2d96844-27f5-441e-89a9-6551bc9ca2d1 admin admin] Calling method '>' {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:24:10.508583 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-b2d96844-27f5-441e-89a9-6551bc9ca2d1 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010715 Sep 30 19:24:10.509114 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 33/66] 10.222.0.17 () {60 vars in 1286 bytes} [Fri Sep 30 19:24:10 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:24:10.520339 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-6bef634c-6dd7-4a5f-a75b-b1776c442d16 admin admin] Calling method '>' {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:24:10.527349 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-6bef634c-6dd7-4a5f-a75b-b1776c442d16 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010709 Sep 30 19:24:10.527852 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 34/67] 10.222.0.17 () {60 vars in 1286 bytes} [Fri Sep 30 19:24:10 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:24:10.539104 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-36cf452d-ef26-40e5-9b96-c365936c945e admin admin] Calling method '>' {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:24:10.546621 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-36cf452d-ef26-40e5-9b96-c365936c945e admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011181 Sep 30 19:24:10.547134 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 34/68] 10.222.0.17 () {60 vars in 1283 bytes} [Fri Sep 30 19:24:10 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:27:04.709163 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-6bef634c-6dd7-4a5f-a75b-b1776c442d16 admin admin] Calling method '>' {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:27:04.710167 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-6bef634c-6dd7-4a5f-a75b-b1776c442d16 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Sep 30 19:27:04.710560 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 35/69] 10.222.0.17 () {56 vars in 1074 bytes} [Fri Sep 30 19:27:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:27:04.848471 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG dbcounter [-] [105427] Writing DB stats nova_api:SELECT=6 {{(pid=105427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:27:05.006042 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-9c9c15b3-3348-421e-9f96-c76476d16c98 admin admin] Calling method '>' {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:27:05.010776 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG oslo_concurrency.lockutils [None req-9c9c15b3-3348-421e-9f96-c76476d16c98 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:27:05.011238 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG oslo_concurrency.lockutils [None req-9c9c15b3-3348-421e-9f96-c76476d16c98 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:27:05.011675 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG oslo_concurrency.lockutils [None req-9c9c15b3-3348-421e-9f96-c76476d16c98 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:27:05.012411 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG oslo_concurrency.lockutils [None req-9c9c15b3-3348-421e-9f96-c76476d16c98 admin admin] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:27:05.012866 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG oslo_concurrency.lockutils [None req-9c9c15b3-3348-421e-9f96-c76476d16c98 admin admin] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:27:05.013292 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG oslo_concurrency.lockutils [None req-9c9c15b3-3348-421e-9f96-c76476d16c98 admin admin] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:27:05.044234 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-9c9c15b3-3348-421e-9f96-c76476d16c98 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.197073 Sep 30 19:27:05.044812 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 35/70] 10.222.0.17 () {60 vars in 1193 bytes} [Fri Sep 30 19:27:04 2022] GET /compute/v2.1/os-services => generated 791 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 30 19:27:06.109071 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-6bef634c-6dd7-4a5f-a75b-b1776c442d16 admin admin] Calling method '>' {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:27:06.110078 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-6bef634c-6dd7-4a5f-a75b-b1776c442d16 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Sep 30 19:27:06.110472 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 36/71] 10.222.0.17 () {56 vars in 1074 bytes} [Fri Sep 30 19:27:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:27:06.297597 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-414f1b95-e073-4a53-ac88-50237ee8a2d2 admin admin] Calling method '>' {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:27:06.300980 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG oslo_concurrency.lockutils [None req-414f1b95-e073-4a53-ac88-50237ee8a2d2 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:27:06.301982 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG oslo_concurrency.lockutils [None req-414f1b95-e073-4a53-ac88-50237ee8a2d2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:27:06.302460 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG oslo_concurrency.lockutils [None req-414f1b95-e073-4a53-ac88-50237ee8a2d2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:27:06.303204 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG oslo_concurrency.lockutils [None req-414f1b95-e073-4a53-ac88-50237ee8a2d2 admin admin] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:27:06.303656 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG oslo_concurrency.lockutils [None req-414f1b95-e073-4a53-ac88-50237ee8a2d2 admin admin] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:27:06.304072 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG oslo_concurrency.lockutils [None req-414f1b95-e073-4a53-ac88-50237ee8a2d2 admin admin] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:27:06.323654 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-414f1b95-e073-4a53-ac88-50237ee8a2d2 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.077882 Sep 30 19:27:06.324206 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 36/72] 10.222.0.17 () {60 vars in 1193 bytes} [Fri Sep 30 19:27:06 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 30 19:27:17.821083 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-6bef634c-6dd7-4a5f-a75b-b1776c442d16 admin admin] Calling method '>' {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:27:17.822081 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-6bef634c-6dd7-4a5f-a75b-b1776c442d16 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Sep 30 19:27:17.822521 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 37/73] 10.222.0.17 () {56 vars in 1074 bytes} [Fri Sep 30 19:27:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:27:17.965780 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG dbcounter [-] [105427] Writing DB stats nova_cell0:SELECT=4 {{(pid=105427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:27:17.966495 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG dbcounter [-] [105427] Writing DB stats nova_cell1:SELECT=4 {{(pid=105427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:27:17.967097 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG dbcounter [-] [105427] Writing DB stats nova_api:SELECT=8 {{(pid=105427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:27:18.012949 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-263270ce-6f48-4e0e-8353-ffe97610b4bf admin admin] Calling method '>' {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:27:18.016353 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG oslo_concurrency.lockutils [None req-263270ce-6f48-4e0e-8353-ffe97610b4bf admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:27:18.016854 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG oslo_concurrency.lockutils [None req-263270ce-6f48-4e0e-8353-ffe97610b4bf admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:27:18.017289 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG oslo_concurrency.lockutils [None req-263270ce-6f48-4e0e-8353-ffe97610b4bf admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:27:18.018035 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG oslo_concurrency.lockutils [None req-263270ce-6f48-4e0e-8353-ffe97610b4bf admin admin] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:27:18.018479 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG oslo_concurrency.lockutils [None req-263270ce-6f48-4e0e-8353-ffe97610b4bf admin admin] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:27:18.018896 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG oslo_concurrency.lockutils [None req-263270ce-6f48-4e0e-8353-ffe97610b4bf admin admin] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:27:18.044207 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-263270ce-6f48-4e0e-8353-ffe97610b4bf admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.082785 Sep 30 19:27:18.044712 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 37/74] 10.222.0.17 () {60 vars in 1193 bytes} [Fri Sep 30 19:27:17 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:27:19.106694 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-6bef634c-6dd7-4a5f-a75b-b1776c442d16 admin admin] Calling method '>' {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:27:19.107703 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-6bef634c-6dd7-4a5f-a75b-b1776c442d16 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Sep 30 19:27:19.108127 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 38/75] 10.222.0.17 () {56 vars in 1074 bytes} [Fri Sep 30 19:27:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:27:19.297282 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-f213c8c3-823c-47f1-9efb-0d3482fbfd1a admin admin] Calling method '>' {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:27:19.300671 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG oslo_concurrency.lockutils [None req-f213c8c3-823c-47f1-9efb-0d3482fbfd1a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:27:19.301146 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG oslo_concurrency.lockutils [None req-f213c8c3-823c-47f1-9efb-0d3482fbfd1a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:27:19.301570 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG oslo_concurrency.lockutils [None req-f213c8c3-823c-47f1-9efb-0d3482fbfd1a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:27:19.302285 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG oslo_concurrency.lockutils [None req-f213c8c3-823c-47f1-9efb-0d3482fbfd1a admin admin] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:27:19.302731 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG oslo_concurrency.lockutils [None req-f213c8c3-823c-47f1-9efb-0d3482fbfd1a admin admin] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:27:19.303977 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: DEBUG oslo_concurrency.lockutils [None req-f213c8c3-823c-47f1-9efb-0d3482fbfd1a admin admin] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:27:19.326949 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-f213c8c3-823c-47f1-9efb-0d3482fbfd1a admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.079353 Sep 30 19:27:19.327417 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 38/76] 10.222.0.17 () {60 vars in 1193 bytes} [Fri Sep 30 19:27:19 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:28:17.231681 dv-cinder-860015-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 30 19:28:17.232211 dv-cinder-860015-1-iscsi devstack@n-api.service[105425]: Fri Sep 30 19:28:17 2022 - graceful shutdown triggered... Sep 30 19:28:17.232668 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: Gracefully killing worker 1 (pid: 105426)... Sep 30 19:28:17.233028 dv-cinder-860015-1-iscsi devstack@n-api.service[105427]: Gracefully killing worker 2 (pid: 105427)... Sep 30 19:28:17.358506 dv-cinder-860015-1-iscsi devstack@n-api.service[105426]: DEBUG dbcounter [-] [105426] Writing DB stats nova_api:SELECT=4 {{(pid=105426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:18.233376 dv-cinder-860015-1-iscsi devstack@n-api.service[105425]: worker 1 buried after 1 seconds Sep 30 19:28:18.233925 dv-cinder-860015-1-iscsi devstack@n-api.service[105425]: worker 2 buried after 1 seconds Sep 30 19:28:18.233925 dv-cinder-860015-1-iscsi devstack@n-api.service[105425]: goodbye to uWSGI. Sep 30 19:28:18.234944 dv-cinder-860015-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 30 19:28:18.235520 dv-cinder-860015-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 30 19:28:18.238463 dv-cinder-860015-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 30 19:28:18.250466 dv-cinder-860015-1-iscsi devstack@n-api.service[120627]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 30 19:28:18.252476 dv-cinder-860015-1-iscsi devstack@n-api.service[120627]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 30 19:28:18 2022] *** Sep 30 19:28:18.252476 dv-cinder-860015-1-iscsi devstack@n-api.service[120627]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 30 19:28:18.252476 dv-cinder-860015-1-iscsi devstack@n-api.service[120627]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 30 19:28:18.252476 dv-cinder-860015-1-iscsi devstack@n-api.service[120627]: nodename: dv-cinder-860015-1-iscsi Sep 30 19:28:18.252476 dv-cinder-860015-1-iscsi devstack@n-api.service[120627]: machine: x86_64 Sep 30 19:28:18.252476 dv-cinder-860015-1-iscsi devstack@n-api.service[120627]: clock source: unix Sep 30 19:28:18.252476 dv-cinder-860015-1-iscsi devstack@n-api.service[120627]: pcre jit disabled Sep 30 19:28:18.252476 dv-cinder-860015-1-iscsi devstack@n-api.service[120627]: detected number of CPU cores: 4 Sep 30 19:28:18.252476 dv-cinder-860015-1-iscsi devstack@n-api.service[120627]: current working directory: / Sep 30 19:28:18.252476 dv-cinder-860015-1-iscsi devstack@n-api.service[120627]: detected binary path: /usr/bin/uwsgi-core Sep 30 19:28:18.253146 dv-cinder-860015-1-iscsi devstack@n-api.service[120627]: your processes number limit is 47680 Sep 30 19:28:18.253146 dv-cinder-860015-1-iscsi devstack@n-api.service[120627]: your memory page size is 4096 bytes Sep 30 19:28:18.253146 dv-cinder-860015-1-iscsi devstack@n-api.service[120627]: detected max file descriptor number: 2048 Sep 30 19:28:18.253146 dv-cinder-860015-1-iscsi devstack@n-api.service[120627]: lock engine: pthread robust mutexes Sep 30 19:28:18.253146 dv-cinder-860015-1-iscsi devstack@n-api.service[120627]: thunder lock: enabled Sep 30 19:28:18.253146 dv-cinder-860015-1-iscsi devstack@n-api.service[120627]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 30 19:28:18.253146 dv-cinder-860015-1-iscsi devstack@n-api.service[120627]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 30 19:28:18.299026 dv-cinder-860015-1-iscsi devstack@n-api.service[120627]: Python main interpreter initialized at 0x557f720ae9c0 Sep 30 19:28:18.299026 dv-cinder-860015-1-iscsi devstack@n-api.service[120627]: python threads support enabled Sep 30 19:28:18.299026 dv-cinder-860015-1-iscsi devstack@n-api.service[120627]: your server socket listen backlog is limited to 100 connections Sep 30 19:28:18.299026 dv-cinder-860015-1-iscsi devstack@n-api.service[120627]: your mercy for graceful operations on workers is 90 seconds Sep 30 19:28:18.299490 dv-cinder-860015-1-iscsi devstack@n-api.service[120627]: mapped 403077 bytes (393 KB) for 2 cores Sep 30 19:28:18.299490 dv-cinder-860015-1-iscsi devstack@n-api.service[120627]: *** Operational MODE: preforking *** Sep 30 19:28:18.299764 dv-cinder-860015-1-iscsi devstack@n-api.service[120627]: *** uWSGI is running in multiple interpreter mode *** Sep 30 19:28:18.299764 dv-cinder-860015-1-iscsi devstack@n-api.service[120627]: spawned uWSGI master process (pid: 120627) Sep 30 19:28:18.299976 dv-cinder-860015-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 30 19:28:18.304405 dv-cinder-860015-1-iscsi devstack@n-api.service[120627]: spawned uWSGI worker 1 (pid: 120648, cores: 1) Sep 30 19:28:18.304405 dv-cinder-860015-1-iscsi devstack@n-api.service[120627]: spawned uWSGI worker 2 (pid: 120649, cores: 1) Sep 30 19:28:18.304405 dv-cinder-860015-1-iscsi devstack@n-api.service[120627]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 30 19:28:18.958727 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 30 19:28:18.976774 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 30 19:28:20.108675 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 30 19:28:20.108675 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: from cryptography.utils import int_from_bytes Sep 30 19:28:20.109314 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 30 19:28:20.109314 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: from cryptography.utils import int_from_bytes Sep 30 19:28:20.141272 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 30 19:28:20.141272 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: from cryptography.utils import int_from_bytes Sep 30 19:28:20.141913 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 30 19:28:20.141913 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: from cryptography.utils import int_from_bytes Sep 30 19:28:22.583010 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 30 19:28:22.583571 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 30 19:28:22.583879 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 30 19:28:22.584079 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 30 19:28:22.584342 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 30 19:28:22.584756 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.585615 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.585934 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.586205 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 30 19:28:22.586632 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.586717 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 30 19:28:22.586796 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.586875 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.587056 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 30 19:28:22.587184 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.587344 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 30 19:28:22.587502 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.587593 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 30 19:28:22.587810 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.588017 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.588121 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.588303 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.588418 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.588634 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.588849 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-860015-1-iscsi {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.588967 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.589183 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.589293 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.589500 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.589606 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.589866 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.589973 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.590620 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.590717 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.590797 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.590870 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.590940 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.591011 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.591089 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.591170 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.591465 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-860015-1-iscsi {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.591636 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.591809 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.592089 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.592423 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.592856 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.593084 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.593303 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.593511 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.593729 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.593946 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.594162 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.594162 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.594566 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.594806 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.595031 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.595031 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.595482 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.595724 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.595942 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.595942 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.596466 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.596466 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.596894 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.597111 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.597316 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.597551 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.597767 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-860015-1-iscsi {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.597994 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.598216 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.598393 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.598649 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.598827 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.599008 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.599193 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-860015-1-iscsi {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.599339 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.599495 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.599664 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.599813 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.600049 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.600235 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.600417 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.601166 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.601344 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.601496 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.603063 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.603224 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.603387 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.603544 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.603695 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.604095 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.604270 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.604457 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.604615 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.604777 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.604926 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.605066 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.605371 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.605570 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.605737 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.605909 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.606088 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.606265 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.606400 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.606561 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.606710 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.606710 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.607000 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.607662 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.607818 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.607818 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.608152 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.608325 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.608519 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.608660 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.608806 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.608971 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.609112 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.609112 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.609387 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.609532 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.609681 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.609827 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.609974 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.609974 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.610248 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.610386 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.610545 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.610704 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.610851 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.610948 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.611040 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.611131 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.611230 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.611316 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.611399 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.611482 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.611572 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.611667 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.611854 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.612247 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.612343 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.612458 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.612554 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.612697 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.612697 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.612892 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.612892 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.613072 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.613158 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.613256 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.613256 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.613410 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.613500 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.613585 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.613675 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.613769 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.613769 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.613939 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.613939 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.614287 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.614434 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.614541 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.614638 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.614723 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.614814 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.614953 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.615055 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.615142 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.615234 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.615318 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.615409 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.615510 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.615624 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.615710 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.615793 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.615884 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.615969 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.616093 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.616093 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.616824 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.616917 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.617009 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.617101 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.617192 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.617192 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.617360 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.617445 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.617539 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.617675 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.617773 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.617866 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.617951 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.618035 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.618126 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.618211 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.618308 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.618393 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.618483 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.618576 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.618667 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.618759 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.618853 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.618938 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.619028 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.619128 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.619219 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.619311 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.619408 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.619500 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.619592 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.619677 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.619767 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.619852 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.619948 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.620041 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.620132 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.620225 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.620320 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.620434 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.620521 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.620606 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.620689 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.620820 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.620925 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.621126 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.621226 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.621431 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.621533 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.621742 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.621906 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.622032 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.622112 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.622356 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.622476 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.622661 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.622808 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.622965 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.623066 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.623282 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.623380 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.623585 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.623685 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.623889 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.623982 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.624225 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.624535 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.624535 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.624714 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.624809 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.624902 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.625123 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.625224 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.625420 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.625524 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.625724 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.625816 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.626040 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.626346 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.626650 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.626907 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.627026 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.627230 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.627349 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.627527 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.627643 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.627832 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.627950 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.628132 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.628249 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.628458 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.628581 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.628759 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.628889 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.629074 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.629192 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.629392 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.629518 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.629704 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.629823 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.631156 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.631262 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.631352 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.631447 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.631610 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.633519 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:28:22.633629 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.633718 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.633816 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.633919 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.634007 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.634090 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.634174 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.634281 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.634384 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.634491 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.634579 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.634669 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.634762 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.634847 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.634946 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.635039 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.635132 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.635216 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.635303 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.635386 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.635482 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.635574 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.635666 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.635758 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.635966 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.636062 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.636162 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.636261 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.636360 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.636470 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.636596 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.636712 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.636852 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.636951 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.637044 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.637179 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.637273 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.637551 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.637642 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.637875 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.637967 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.638197 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.638291 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.638514 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.638626 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.638824 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.638928 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.639140 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.639240 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.639485 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.639597 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.639800 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.639899 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.640125 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.640224 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.640470 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.640582 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.640784 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.640884 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.641096 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.641194 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.641401 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.641505 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.641711 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.641810 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.642043 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.642141 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.642356 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.642456 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.642669 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.642767 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.642980 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.643082 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.643291 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.643382 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.643602 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.643748 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.643914 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.644023 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.644225 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.644329 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.644565 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.644665 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.644864 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.644968 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.645181 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.645284 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.645500 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.645599 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.645819 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.645942 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.646132 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.646231 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.646459 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.646641 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.646884 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.647148 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.647305 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.647400 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.647522 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.647652 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.647739 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.647996 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.648089 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.648301 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.648470 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.648655 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.648782 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.648943 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.649090 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.649251 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.649401 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.649556 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.649706 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.649880 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.650029 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.650210 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.650359 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.650519 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.650669 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.650855 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.651005 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.651163 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.651313 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.651491 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.651667 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.651788 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.651923 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.652101 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.652237 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.652440 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.652564 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.652755 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.652861 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.653058 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.653165 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.653368 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.653522 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.653765 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.653884 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.654029 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.654127 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.654303 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.654397 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.654629 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.654738 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.654939 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.655053 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.655245 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.655345 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.655575 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.655723 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.655863 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.655998 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.656178 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.656293 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.656516 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.656622 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.656825 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.656955 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.657145 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.657250 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.657457 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.657560 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.657767 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.657885 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.658099 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.658210 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.658430 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.658539 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.658731 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.658842 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.659052 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.659164 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.659642 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.659745 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.659959 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.660076 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.660262 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.660409 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.660594 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.660704 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.660901 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.661012 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.661206 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.661309 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.661509 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.661612 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.661819 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.661922 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.662122 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.662234 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.662428 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.662538 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.662731 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.662840 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.663570 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.663719 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.664038 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.664138 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.664283 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.664415 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.664517 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.664610 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.664786 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.664879 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.665088 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.665180 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.665389 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.665488 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.665733 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.665839 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.666040 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.666162 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.666379 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.666482 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.666713 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.666814 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.667028 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.667126 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.667348 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.667438 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.667656 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.667755 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.667969 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.668060 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.668274 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.668437 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.668607 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.668714 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.668918 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.669009 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.669226 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.669330 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.669545 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.669637 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.669854 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.669952 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.670173 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.670271 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.670480 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.670570 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.670801 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.670900 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.671110 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.671200 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.671428 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.671520 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.671731 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.671831 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.672042 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.672144 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.672404 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.672512 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.672731 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.672830 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.673048 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.673147 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.673368 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.673461 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.674257 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.674409 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.674409 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.674588 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.674681 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.674767 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.674866 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.674954 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.675038 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.675131 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.675265 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.675358 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.675477 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.675568 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.675787 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.675927 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.676130 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.676229 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.676454 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.676557 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.676744 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.676854 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.677052 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.677152 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.677366 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.677471 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.677671 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.677777 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.677977 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.678077 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.678303 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.678402 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.678678 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.678771 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.678986 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.679085 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.679296 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.679395 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.679617 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.679725 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.679926 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.680018 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.680230 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.680329 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.680564 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.680677 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.680869 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.680970 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.681173 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.681348 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.681482 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.681575 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.681800 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.681898 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.682111 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.682217 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.682421 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.682513 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.682726 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.682825 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.683039 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.683140 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.683347 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.683438 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.683648 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.683746 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.683951 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.684085 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.684259 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.684385 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.684619 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.684729 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.684919 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.685015 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.685240 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.685377 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.685556 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.685656 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.685858 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.685958 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.686161 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.686309 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.686478 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.686627 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.686784 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.686884 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.687085 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.687184 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.687389 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.687481 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.687689 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.687787 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.688029 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.688121 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.688336 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.688472 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.688662 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.688755 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.688975 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.689073 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.689291 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.689394 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.689601 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.689703 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.689909 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.690010 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.690216 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.690320 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.690521 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.690618 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.690840 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.690938 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.691152 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.691251 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.691459 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.691565 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.691767 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.691865 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.692076 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.692168 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.692399 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.692511 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.692715 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.692815 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.693035 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.693135 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.693340 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.693431 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.693648 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.693747 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.693957 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.694093 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.694819 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.694940 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.695130 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.695222 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.695451 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.695584 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.696147 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.696517 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.696914 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.697236 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.697584 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.697904 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.698238 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.698545 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.698664 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.698920 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.699025 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.699273 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.699376 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.699586 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.699697 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.699892 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.699996 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.700197 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.700329 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.700531 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.700668 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.700837 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.701012 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.701144 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.701341 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.701443 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.701662 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.701756 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.701987 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.702082 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.702303 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.702406 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.702616 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.702784 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.702929 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.703071 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.703221 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.703362 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.703508 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.703662 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.703801 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.703949 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.704116 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.704254 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.704470 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.704582 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.704722 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.704815 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.705036 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.705141 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.705338 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.705508 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.705639 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.705741 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.705954 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.706054 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.706259 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.706392 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.706575 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.706690 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.706903 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.707005 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.707219 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.707313 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.707529 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.707627 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.707833 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.707932 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.708140 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.708232 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.708469 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.708569 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.708773 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.708913 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.709076 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.709177 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.709383 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.709485 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.709691 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.709816 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.710046 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.710142 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.710361 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.710471 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.710671 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.710791 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.710979 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.711073 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.711288 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.711391 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.711590 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.711706 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.711943 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.712109 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.712252 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.712407 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.712545 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.712768 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.712907 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.713047 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.713194 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.713334 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.713487 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.713626 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.713775 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.713914 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.714063 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.714209 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.714313 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.714400 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.714571 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.714664 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.714874 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.714966 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.715712 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.715809 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.715896 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.716023 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.716126 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.716213 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.716301 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.716450 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.716544 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.716632 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.716725 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.716819 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.716983 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.717082 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.717276 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.717377 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.717587 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.717693 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.717893 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.717993 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.718196 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.718289 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.718499 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.718604 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.718798 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.718897 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.719102 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.719194 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.719407 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.719581 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.719725 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.719826 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.720037 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.720137 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.720337 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.720493 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.720666 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.720760 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.720967 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.721067 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.721271 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.721372 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.721574 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.721681 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.721881 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.721973 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.722181 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.722274 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.722482 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.722576 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.722784 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.722877 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.723085 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.723187 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.723386 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.723486 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.723689 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.723827 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.723993 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.724145 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.724302 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.724482 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.724652 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.724761 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.724958 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.725059 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.725263 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.725418 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.726107 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.726251 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.726417 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.726586 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.726747 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.726893 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.727062 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.727195 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.727368 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.727515 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.727674 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.727828 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.727979 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.728140 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.728326 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.728492 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.728663 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.728765 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.729023 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.729125 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.729330 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.729426 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.729648 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.729749 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.729959 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.730053 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.730262 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.730357 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.730576 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.730708 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.730885 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.730979 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.731189 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.731290 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.731506 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.731607 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.731815 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.731909 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.732129 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.732231 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.732449 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.732564 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.732754 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.732847 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.733061 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.733162 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.733367 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.733476 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.733677 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.733770 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.733986 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.734079 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.734301 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.734435 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.734616 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.734760 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.734902 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.735041 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.735191 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.735293 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.735500 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.735638 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.735808 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.735956 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.736109 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.736254 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.736440 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.736579 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.736731 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.736819 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.737060 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.737213 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.737365 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.737465 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.737675 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.737767 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.737987 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.738089 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.738296 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.738389 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.738610 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.738923 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.739127 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.739220 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.739444 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.739544 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.739837 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.739940 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.740144 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.740237 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.740480 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.740624 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.740788 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.740896 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.741175 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.741271 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.741493 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.741587 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.741857 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.742020 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.742179 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.742306 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.742489 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.742584 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.742831 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.742937 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.743144 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.743238 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.743459 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.743551 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.743779 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.743889 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.744090 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.744189 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.744414 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.744523 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.744731 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.744828 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.745059 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.745160 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.745412 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.745523 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.745665 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.745759 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.745970 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.746063 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.746293 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.746422 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.746597 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.746733 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.746919 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.747013 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.747232 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.747350 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.747537 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.747635 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.747845 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.747937 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.748170 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.748321 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.748502 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.748658 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.748826 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.748971 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.749245 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.749421 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.749559 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.749653 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.749866 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.749969 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.750202 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.750301 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.750516 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.750616 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.750828 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.750934 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.751151 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.751252 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.751474 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.751574 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.751783 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.751886 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.752098 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.752198 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.752420 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.752531 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.752744 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.752839 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.753068 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.753160 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.753381 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.753472 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.753694 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.753787 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.754012 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.754106 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.754321 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.754424 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.754646 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.754795 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.754971 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.755072 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.755289 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.755383 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.755617 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.755722 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.755920 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.756033 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.756230 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.756358 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.757234 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.757400 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.757542 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.757634 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.757881 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.758020 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.758188 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.758339 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.758495 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.758657 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.758805 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.758974 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.759110 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.759286 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.759417 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.759594 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.759741 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.759901 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.760050 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.760225 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.760394 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.760557 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.760703 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.760881 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.761014 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.761199 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.761370 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.761521 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.761629 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.761843 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.761945 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.762148 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.762249 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.762470 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.762574 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.762780 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.762882 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.763101 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.763213 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.763386 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.763489 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.763690 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.763791 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.764032 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.764126 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.764335 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.764483 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.764670 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.764776 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.764976 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.765071 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.765280 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.765374 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.765669 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.765774 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.765927 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.766028 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.766248 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.766349 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.766576 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.766675 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.766888 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.766990 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.767207 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.767354 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.767533 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.767626 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.767838 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.767946 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.768142 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.768236 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.768473 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.768570 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.768779 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.768893 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.769083 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.769186 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.769388 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.769490 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.769690 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.769791 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.769989 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.770088 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.770293 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.770386 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.770594 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.770699 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.770896 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.770988 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.771205 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.771298 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.771508 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.771612 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.771812 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.771906 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.772114 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.772205 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.772999 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.773117 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.773305 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.773407 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.773628 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.773720 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.773941 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.774036 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.774250 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.774351 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.774557 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.774652 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.774863 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.775004 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.775179 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.775279 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.775499 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.775603 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.775820 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.775933 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.776128 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.776220 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.776463 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.776572 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.776782 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.776916 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.777106 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.777239 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.777422 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.777528 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.777798 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.777898 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.778049 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.778130 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.778365 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.778482 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.778680 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.778994 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.779132 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.779243 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.779348 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.779522 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.779623 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.779832 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.779926 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.780143 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.780540 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.780649 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.780784 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.780886 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.781076 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.781169 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.781387 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.781489 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.781699 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.781791 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.782005 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.782112 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.782318 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.782417 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.782631 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.782732 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.782945 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.783053 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.783258 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.783359 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.783572 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.783666 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.783882 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.783983 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.784198 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.784292 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.784804 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.784922 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.785166 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.785267 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.785482 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.785582 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.785790 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.786005 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.786112 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.786198 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.786406 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.786507 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.786763 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.786871 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.787085 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.787178 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.787395 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.787526 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.787711 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.787853 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.788056 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.788171 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.788384 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.788496 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.788755 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.788861 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.789068 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.789171 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.789380 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.789480 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.789689 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.789791 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.790002 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.790097 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.790313 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.790415 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.790628 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.790724 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.790937 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.791030 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.791252 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.791355 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.791584 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.791773 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.791906 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.792090 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.792222 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.792444 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.792575 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.792771 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.792895 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.793094 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.793415 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.793525 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.793727 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.793829 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.794055 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.794159 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.794364 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.794472 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.794687 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.794788 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.795007 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.795109 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.795328 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.795440 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.795658 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.795760 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.795982 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.796099 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.796279 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.796410 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.796619 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.796732 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.796935 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.797045 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.797241 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.797341 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.797564 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.797774 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.797878 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.798123 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.798238 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.798439 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.798550 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.798771 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.798874 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.799160 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.799312 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.799481 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.799665 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.799786 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.799985 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.800094 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.800317 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.800445 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.800674 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.800778 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.800995 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.801102 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.801304 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.801405 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.801605 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.801698 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.801909 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.802083 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.802219 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.802314 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.802529 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.802630 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.802832 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.802934 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.803138 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.803230 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.803438 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.803547 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.803776 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.803871 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.804082 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.804173 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.804413 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.804522 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.804711 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.804811 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.805020 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.805133 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.805330 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.805440 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.805633 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.805737 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.805940 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.806076 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.806240 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.806356 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.806552 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.806654 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.806854 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.806976 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.807166 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.807301 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.807476 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.807605 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.807783 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.807891 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.808096 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.808212 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.808427 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.808532 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.808791 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.808885 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.809117 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.809221 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.809427 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.809528 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.809730 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.809833 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.810046 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.810153 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.810356 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.810450 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.810676 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.810786 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.810981 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.811089 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.811289 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.811391 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.811605 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.811798 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.811930 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.812120 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.812215 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.812552 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.812683 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.812870 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.813017 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.813217 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.813348 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.813536 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.813657 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.813988 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.814094 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.814296 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.814389 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.814603 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.814697 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.814907 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.815010 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.815230 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.815331 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.815544 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.815641 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.815855 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.815958 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.816164 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.816258 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.816493 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.816602 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.816805 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.816899 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.817114 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.817214 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.817421 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.817524 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.817731 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.817924 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.818068 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.818212 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.818374 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.818524 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.818617 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.818702 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.818925 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.819027 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.819753 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.819872 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.820061 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.820163 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.820462 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.820561 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.820709 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.820804 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.821019 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.821111 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.821331 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.821424 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.821649 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.821749 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.821965 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.822058 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.822276 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.822368 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.822586 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.822680 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.822895 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.822996 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.823204 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.823305 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.823513 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.823606 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.823827 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.823922 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.824140 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.824242 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.824463 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.824559 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.824793 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.824888 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.825125 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.825239 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.825443 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.825598 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.825751 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.825844 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.826105 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.826197 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.826428 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.826544 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.826752 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.826857 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.827062 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.827157 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.827385 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.827488 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.827702 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.827961 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.828172 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.828318 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.828524 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.828676 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.828821 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.828980 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.829119 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.829270 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.829423 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.829574 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.829574 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.829848 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.829998 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.830136 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.830288 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.830430 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.830581 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.830732 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.830875 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.831023 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.831185 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.831335 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.831485 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.831706 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.831846 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.831996 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.832136 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.832280 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.832447 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.832585 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.832729 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.832870 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.833057 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.833224 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.833375 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.833518 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.833657 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.833798 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.833946 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.834087 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.834237 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.834387 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.834537 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.834687 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.834880 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.835038 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.835202 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.835353 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.835496 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.835654 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.835823 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.835974 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.836126 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.836278 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.836278 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.836546 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.836641 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.836785 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.836880 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.836975 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.837105 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.837200 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.837413 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.837531 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.837716 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.837823 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.838023 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.838261 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.838419 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.838574 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.838753 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.838921 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.839059 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.839200 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.839356 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.839498 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.839647 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.839787 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.839944 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.840078 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.840227 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.840396 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.840501 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.840590 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.840820 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.840914 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.841136 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.841230 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.841447 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.841549 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.841760 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.841851 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.842067 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.842161 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.842376 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.842478 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.842686 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.842788 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.842995 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.843134 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.843300 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.843400 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.843606 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.843711 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.843923 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.844022 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.844241 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.844341 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.844569 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.844672 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.844879 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.844977 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.845196 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.845289 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.845516 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.845835 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.845969 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.846145 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.846248 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.846472 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.846633 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.846787 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.846901 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.847099 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.847209 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.847403 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.847545 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.847712 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.847803 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.848026 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.848166 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.848342 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.848469 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.848677 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.848782 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.848990 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.849091 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.849308 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.849403 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.849616 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.849715 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.849940 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.850033 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.850264 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.850356 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.851102 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.851206 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.851430 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.851533 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.851755 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.851848 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.852084 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.852191 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.852417 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.852528 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.852733 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.852827 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.853036 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.853130 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.853279 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 30 19:28:22.853381 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.853679 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.853984 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:28:22.854227 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 30 19:28:22.914054 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO dbcounter [None req-b5f04e7a-9681-4195-9d39-fc6985de847e None None] Registered counter for database nova_api Sep 30 19:28:22.915429 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO dbcounter [None req-00ba7eb3-614a-45c8-b7a1-fac3e2aa99cf None None] Registered counter for database nova_api Sep 30 19:28:22.934817 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_db.sqlalchemy.engines [None req-b5f04e7a-9681-4195-9d39-fc6985de847e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120649) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 30 19:28:22.936280 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_db.sqlalchemy.engines [None req-00ba7eb3-614a-45c8-b7a1-fac3e2aa99cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120648) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 30 19:28:22.941822 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writer thread running {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 30 19:28:22.942915 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writer thread running {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 30 19:28:22.997386 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.context [None req-b5f04e7a-9681-4195-9d39-fc6985de847e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd(cell1) {{(pid=120649) load_cells /opt/stack/nova/nova/context.py:464}} Sep 30 19:28:22.997982 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.context [None req-00ba7eb3-614a-45c8-b7a1-fac3e2aa99cf None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd(cell1) {{(pid=120648) load_cells /opt/stack/nova/nova/context.py:464}} Sep 30 19:28:23.001407 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b5f04e7a-9681-4195-9d39-fc6985de847e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:28:23.001897 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b5f04e7a-9681-4195-9d39-fc6985de847e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:28:23.002024 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-00ba7eb3-614a-45c8-b7a1-fac3e2aa99cf None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:28:23.002446 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-00ba7eb3-614a-45c8-b7a1-fac3e2aa99cf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:28:23.003459 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b5f04e7a-9681-4195-9d39-fc6985de847e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:28:23.004009 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-00ba7eb3-614a-45c8-b7a1-fac3e2aa99cf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:28:23.004194 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b5f04e7a-9681-4195-9d39-fc6985de847e None None] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:28:23.004679 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b5f04e7a-9681-4195-9d39-fc6985de847e None None] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:28:23.004799 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-00ba7eb3-614a-45c8-b7a1-fac3e2aa99cf None None] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:28:23.005208 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-00ba7eb3-614a-45c8-b7a1-fac3e2aa99cf None None] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:28:23.006715 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b5f04e7a-9681-4195-9d39-fc6985de847e None None] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:28:23.007234 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-00ba7eb3-614a-45c8-b7a1-fac3e2aa99cf None None] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:28:23.008703 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO dbcounter [None req-b5f04e7a-9681-4195-9d39-fc6985de847e None None] Registered counter for database nova_cell0 Sep 30 19:28:23.009220 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO dbcounter [None req-00ba7eb3-614a-45c8-b7a1-fac3e2aa99cf None None] Registered counter for database nova_cell0 Sep 30 19:28:23.012918 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO dbcounter [None req-b5f04e7a-9681-4195-9d39-fc6985de847e None None] Registered counter for database nova_cell1 Sep 30 19:28:23.013202 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO dbcounter [None req-00ba7eb3-614a-45c8-b7a1-fac3e2aa99cf None None] Registered counter for database nova_cell1 Sep 30 19:28:23.020349 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_db.sqlalchemy.engines [None req-b5f04e7a-9681-4195-9d39-fc6985de847e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120649) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 30 19:28:23.024982 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_db.sqlalchemy.engines [None req-00ba7eb3-614a-45c8-b7a1-fac3e2aa99cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120648) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 30 19:28:23.025713 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writer thread running {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 30 19:28:23.026368 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_db.sqlalchemy.engines [None req-b5f04e7a-9681-4195-9d39-fc6985de847e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120649) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 30 19:28:23.026683 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_db.sqlalchemy.engines [None req-00ba7eb3-614a-45c8-b7a1-fac3e2aa99cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120648) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 30 19:28:23.033082 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writer thread running {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 30 19:28:23.034605 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writer thread running {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 30 19:28:23.170745 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writer thread running {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 30 19:28:23.182258 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO dbcounter [None req-00ba7eb3-614a-45c8-b7a1-fac3e2aa99cf None None] Registered counter for database nova_cell0 Sep 30 19:28:23.187592 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO dbcounter [None req-b5f04e7a-9681-4195-9d39-fc6985de847e None None] Registered counter for database nova_cell0 Sep 30 19:28:23.189243 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_db.sqlalchemy.engines [None req-00ba7eb3-614a-45c8-b7a1-fac3e2aa99cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120648) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 30 19:28:23.193945 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writer thread running {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 30 19:28:23.195128 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_db.sqlalchemy.engines [None req-b5f04e7a-9681-4195-9d39-fc6985de847e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120649) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 30 19:28:23.199677 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writer thread running {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 30 19:28:23.513522 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: WARNING keystonemiddleware.auth_token [None req-00ba7eb3-614a-45c8-b7a1-fac3e2aa99cf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 30 19:28:23.516550 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: WARNING keystonemiddleware.auth_token [None req-b5f04e7a-9681-4195-9d39-fc6985de847e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 30 19:28:23.521092 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: WARNING keystonemiddleware.auth_token [None req-00ba7eb3-614a-45c8-b7a1-fac3e2aa99cf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 30 19:28:23.524443 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: WARNING keystonemiddleware.auth_token [None req-b5f04e7a-9681-4195-9d39-fc6985de847e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 30 19:28:23.865286 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: WARNING keystonemiddleware.auth_token [None req-00ba7eb3-614a-45c8-b7a1-fac3e2aa99cf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 30 19:28:23.870834 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: WARNING keystonemiddleware.auth_token [None req-b5f04e7a-9681-4195-9d39-fc6985de847e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 30 19:28:23.871756 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: WARNING keystonemiddleware.auth_token [None req-00ba7eb3-614a-45c8-b7a1-fac3e2aa99cf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 30 19:28:23.877020 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: WARNING keystonemiddleware.auth_token [None req-b5f04e7a-9681-4195-9d39-fc6985de847e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 30 19:28:23.877154 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557f720ae9c0 pid: 120648 (default app) Sep 30 19:28:23.882348 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557f720ae9c0 pid: 120649 (default app) Sep 30 19:28:59.446542 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=3 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:59.452239 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=3 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:59.454094 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=3 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:59.456549 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=3 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:00.051647 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_api:SELECT=3 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:00.054244 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell0:SELECT=3 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:00.057095 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell1:SELECT=3 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:00.059850 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell0:SELECT=3 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:01.073623 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-aaf94942-23d3-4108-9824-0c39563cc007 tempest-VolumesSnapshotsTestJSON-404884988 tempest-VolumesSnapshotsTestJSON-404884988-project] Action: 'create', calling method: .version_select at 0x7f621feef5e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-574624118"}} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:29:01.423411 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-13c0e2a7-a860-4899-a1f7-735d9354606a tempest-VolumesNegativeTest-1896847921 tempest-VolumesNegativeTest-1896847921-project] Action: 'create', calling method: .version_select at 0x7f621fef0550>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-820376838", "metadata": {"Type": "work"}}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:29:01.436034 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-13c0e2a7-a860-4899-a1f7-735d9354606a tempest-VolumesNegativeTest-1896847921 tempest-VolumesNegativeTest-1896847921-project] Request method failure captured: Sep 30 19:29:01.436034 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 30 19:29:01.436034 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 30 19:29:01.436034 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 30 19:29:01.436034 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Connection: close Sep 30 19:29:01.436034 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Length: 121 Sep 30 19:29:01.436034 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 30 19:29:01.436034 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Host: 10.222.0.17 Sep 30 19:29:01.436034 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 30 19:29:01.436034 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 30 19:29:01.436034 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjN0N7Osiw3JIPN3ccTtB_SWreuc2kxYENW1WB2NGv2LCfMpnkzzru3QmX4u4HdPOQOEq4EzfhNbewmw4bitLpu4MHD40bsXRmoOrYlh8txf5PjkHwCaGON6Vmrn_K7V1HHSn6Wc-Zi2uCdum87KQ7bFAu-dNFJV75wxx3ZaQ3ZzRMSo8 Sep 30 19:29:01.436034 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 30 19:29:01.436034 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 30 19:29:01.436034 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 30 19:29:01.436034 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 30 19:29:01.436034 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 30 19:29:01.436034 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 30 19:29:01.436034 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Id: 1a4bb3c6a6714a1daae48c35f9b85aba Sep 30 19:29:01.436034 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-VolumesNegativeTest-1896847921 Sep 30 19:29:01.436034 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 30 19:29:01.436034 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 30 19:29:01.437906 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1a4bb3c6a6714a1daae48c35f9b85aba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1a4bb3c6a6714a1daae48c35f9b85aba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1a4bb3c6a6714a1daae48c35f9b85aba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1a4bb3c6a6714a1daae48c35f9b85aba"}]}] Sep 30 19:29:01.437906 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-VolumesNegativeTest-1896847921 Sep 30 19:29:01.437906 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Id: 1a4bb3c6a6714a1daae48c35f9b85aba Sep 30 19:29:01.437906 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-VolumesNegativeTest-1896847921 Sep 30 19:29:01.437906 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User: tempest-VolumesNegativeTest-1896847921-project Sep 30 19:29:01.437906 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 30 19:29:01.437906 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 30 19:29:01.437906 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Id: 144feda2a2474edfa8dc3e25ae3074b2 Sep 30 19:29:01.437906 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-VolumesNegativeTest-1896847921-project Sep 30 19:29:01.437906 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Sep 30 19:29:01.437906 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-820376838", "metadata": {"Type": "work"}}} Sep 30 19:29:01.437906 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: method: Sep 30 19:29:01.437906 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 30 19:29:01.439585 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-820376838', 'metadata': {'Type': 'work'}}}} Sep 30 19:29:01.439585 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:29:01.439585 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:29:01.439585 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 30 19:29:01.439585 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 30 19:29:01.439585 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 30 19:29:01.439585 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise error Sep 30 19:29:01.439585 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 30 19:29:01.439585 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:01.439585 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 30 19:29:01.439585 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 30 19:29:01.439585 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:01.439585 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 30 19:29:01.439585 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi '#$%' Sep 30 19:29:01.439585 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:01.439585 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:29:01.439585 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:01.439585 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:29:01.439585 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:29:01.439585 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:29:01.439585 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:29:01.439585 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:29:01.441362 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 30 19:29:01.441362 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 30 19:29:01.441362 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:29:01.441362 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:29:01.441362 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 30 19:29:01.441362 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 30 19:29:01.441362 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 30 19:29:01.441362 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 30 19:29:01.441362 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 30 19:29:01.441362 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 30 19:29:01.441362 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 30 19:29:01.441362 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:01.441362 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:29:01.441362 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:01.441362 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:29:01.441362 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:29:01.441362 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:29:01.441362 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 30 19:29:01.441362 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 30 19:29:01.444119 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 30 19:29:01.444119 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:01.448524 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-13c0e2a7-a860-4899-a1f7-735d9354606a tempest-VolumesNegativeTest-1896847921 tempest-VolumesNegativeTest-1896847921-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:29:01.451729 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-13c0e2a7-a860-4899-a1f7-735d9354606a tempest-VolumesNegativeTest-1896847921 tempest-VolumesNegativeTest-1896847921-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 2.025973 Sep 30 19:29:01.452670 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 1/1] 10.222.0.17 () {60 vars in 1156 bytes} [Fri Sep 30 19:28:59 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 2030 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 30 19:29:01.470326 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-059b80c8-b5cb-44d6-856f-4a184575b45e tempest-VolumesNegativeTest-1896847921 tempest-VolumesNegativeTest-1896847921-project] Action: 'create', calling method: .version_select at 0x7f621fef0e50>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-558493287", "metadata": {"Type": "work"}}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:29:01.485993 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-059b80c8-b5cb-44d6-856f-4a184575b45e tempest-VolumesNegativeTest-1896847921 tempest-VolumesNegativeTest-1896847921-project] Request method failure captured: Sep 30 19:29:01.485993 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 30 19:29:01.485993 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 30 19:29:01.485993 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 30 19:29:01.485993 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Connection: close Sep 30 19:29:01.485993 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Length: 119 Sep 30 19:29:01.485993 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 30 19:29:01.485993 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Host: 10.222.0.17 Sep 30 19:29:01.485993 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 30 19:29:01.485993 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 30 19:29:01.485993 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjN0N7Osiw3JIPN3ccTtB_SWreuc2kxYENW1WB2NGv2LCfMpnkzzru3QmX4u4HdPOQOEq4EzfhNbewmw4bitLpu4MHD40bsXRmoOrYlh8txf5PjkHwCaGON6Vmrn_K7V1HHSn6Wc-Zi2uCdum87KQ7bFAu-dNFJV75wxx3ZaQ3ZzRMSo8 Sep 30 19:29:01.485993 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 30 19:29:01.485993 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 30 19:29:01.485993 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 30 19:29:01.485993 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 30 19:29:01.485993 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 30 19:29:01.485993 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 30 19:29:01.485993 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Id: 1a4bb3c6a6714a1daae48c35f9b85aba Sep 30 19:29:01.485993 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-VolumesNegativeTest-1896847921 Sep 30 19:29:01.485993 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 30 19:29:01.485993 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 30 19:29:01.487676 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1a4bb3c6a6714a1daae48c35f9b85aba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1a4bb3c6a6714a1daae48c35f9b85aba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1a4bb3c6a6714a1daae48c35f9b85aba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1a4bb3c6a6714a1daae48c35f9b85aba"}]}] Sep 30 19:29:01.487676 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-VolumesNegativeTest-1896847921 Sep 30 19:29:01.487676 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Id: 1a4bb3c6a6714a1daae48c35f9b85aba Sep 30 19:29:01.487676 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-VolumesNegativeTest-1896847921 Sep 30 19:29:01.487676 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User: tempest-VolumesNegativeTest-1896847921-project Sep 30 19:29:01.487676 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 30 19:29:01.487676 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 30 19:29:01.487676 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Id: 144feda2a2474edfa8dc3e25ae3074b2 Sep 30 19:29:01.487676 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-VolumesNegativeTest-1896847921-project Sep 30 19:29:01.487676 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Sep 30 19:29:01.487676 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-558493287", "metadata": {"Type": "work"}}} Sep 30 19:29:01.487676 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: method: Sep 30 19:29:01.487676 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 30 19:29:01.488678 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-558493287', 'metadata': {'Type': 'work'}}}} Sep 30 19:29:01.488678 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:29:01.488678 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:29:01.488678 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 30 19:29:01.488678 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 30 19:29:01.488678 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 30 19:29:01.488678 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise error Sep 30 19:29:01.488678 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 30 19:29:01.488678 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:01.488678 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 30 19:29:01.488678 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 30 19:29:01.488678 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:01.488678 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 30 19:29:01.488678 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi '0' Sep 30 19:29:01.488678 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:01.488678 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:29:01.488678 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:01.488678 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:29:01.488678 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:29:01.488678 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:29:01.488678 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:29:01.488678 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:29:01.490119 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 30 19:29:01.490119 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 30 19:29:01.490119 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:29:01.490119 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:29:01.490119 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 30 19:29:01.490119 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 30 19:29:01.490119 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 30 19:29:01.490119 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 30 19:29:01.490119 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 30 19:29:01.490119 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 30 19:29:01.490119 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 30 19:29:01.490119 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:01.490119 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:29:01.490119 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:01.490119 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:29:01.490119 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:29:01.490119 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:29:01.490119 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 30 19:29:01.490119 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 30 19:29:01.491379 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 30 19:29:01.491379 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:01.491379 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-059b80c8-b5cb-44d6-856f-4a184575b45e tempest-VolumesNegativeTest-1896847921 tempest-VolumesNegativeTest-1896847921-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:29:01.491379 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-059b80c8-b5cb-44d6-856f-4a184575b45e tempest-VolumesNegativeTest-1896847921 tempest-VolumesNegativeTest-1896847921-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.028839 Sep 30 19:29:01.492947 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 2/2] 10.222.0.17 () {60 vars in 1156 bytes} [Fri Sep 30 19:29:01 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 30 19:29:01.503216 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-76134eff-f17e-49d7-ae4a-d2d81df22ed7 tempest-VolumesNegativeTest-1896847921 tempest-VolumesNegativeTest-1896847921-project] Action: 'create', calling method: .version_select at 0x7f621fda9280>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1572552743", "metadata": {"Type": "work"}}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:29:01.515090 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-76134eff-f17e-49d7-ae4a-d2d81df22ed7 tempest-VolumesNegativeTest-1896847921 tempest-VolumesNegativeTest-1896847921-project] Request method failure captured: Sep 30 19:29:01.515090 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 30 19:29:01.515090 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 30 19:29:01.515090 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 30 19:29:01.515090 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Connection: close Sep 30 19:29:01.515090 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Length: 119 Sep 30 19:29:01.515090 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 30 19:29:01.515090 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Host: 10.222.0.17 Sep 30 19:29:01.515090 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 30 19:29:01.515090 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 30 19:29:01.515090 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjN0N7Osiw3JIPN3ccTtB_SWreuc2kxYENW1WB2NGv2LCfMpnkzzru3QmX4u4HdPOQOEq4EzfhNbewmw4bitLpu4MHD40bsXRmoOrYlh8txf5PjkHwCaGON6Vmrn_K7V1HHSn6Wc-Zi2uCdum87KQ7bFAu-dNFJV75wxx3ZaQ3ZzRMSo8 Sep 30 19:29:01.515090 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 30 19:29:01.515090 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 30 19:29:01.515090 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 30 19:29:01.515090 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 30 19:29:01.515090 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 30 19:29:01.515090 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 30 19:29:01.515090 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Id: 1a4bb3c6a6714a1daae48c35f9b85aba Sep 30 19:29:01.515090 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-VolumesNegativeTest-1896847921 Sep 30 19:29:01.515090 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 30 19:29:01.515090 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 30 19:29:01.516507 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1a4bb3c6a6714a1daae48c35f9b85aba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1a4bb3c6a6714a1daae48c35f9b85aba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1a4bb3c6a6714a1daae48c35f9b85aba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1a4bb3c6a6714a1daae48c35f9b85aba"}]}] Sep 30 19:29:01.516507 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-VolumesNegativeTest-1896847921 Sep 30 19:29:01.516507 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Id: 1a4bb3c6a6714a1daae48c35f9b85aba Sep 30 19:29:01.516507 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-VolumesNegativeTest-1896847921 Sep 30 19:29:01.516507 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User: tempest-VolumesNegativeTest-1896847921-project Sep 30 19:29:01.516507 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 30 19:29:01.516507 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 30 19:29:01.516507 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Id: 144feda2a2474edfa8dc3e25ae3074b2 Sep 30 19:29:01.516507 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-VolumesNegativeTest-1896847921-project Sep 30 19:29:01.516507 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Sep 30 19:29:01.516507 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1572552743", "metadata": {"Type": "work"}}} Sep 30 19:29:01.516507 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: method: Sep 30 19:29:01.516507 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 30 19:29:01.517350 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1572552743', 'metadata': {'Type': 'work'}}}} Sep 30 19:29:01.517350 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:29:01.517350 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:29:01.517350 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 30 19:29:01.517350 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 30 19:29:01.517350 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 30 19:29:01.517350 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise error Sep 30 19:29:01.517350 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 30 19:29:01.517350 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:01.517350 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 30 19:29:01.517350 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 30 19:29:01.517350 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:01.517350 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 30 19:29:01.517350 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi '' Sep 30 19:29:01.517350 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:01.517350 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:29:01.517350 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:01.517350 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:29:01.517350 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:29:01.517350 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:29:01.517350 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:29:01.517350 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:29:01.518655 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 30 19:29:01.518655 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 30 19:29:01.518655 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:29:01.518655 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:29:01.518655 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 30 19:29:01.518655 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 30 19:29:01.518655 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 30 19:29:01.518655 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 30 19:29:01.518655 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 30 19:29:01.518655 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 30 19:29:01.518655 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 30 19:29:01.518655 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:01.518655 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:29:01.518655 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:01.518655 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:29:01.518655 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:29:01.518655 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:29:01.518655 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 30 19:29:01.518655 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 30 19:29:01.519844 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 30 19:29:01.519844 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:01.519844 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-76134eff-f17e-49d7-ae4a-d2d81df22ed7 tempest-VolumesNegativeTest-1896847921 tempest-VolumesNegativeTest-1896847921-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:29:01.519844 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-76134eff-f17e-49d7-ae4a-d2d81df22ed7 tempest-VolumesNegativeTest-1896847921 tempest-VolumesNegativeTest-1896847921-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.020724 Sep 30 19:29:01.523651 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 3/3] 10.222.0.17 () {60 vars in 1156 bytes} [Fri Sep 30 19:29:01 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 30 19:29:01.532791 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-1111d9fd-569d-467c-977e-ecbf9729f60f tempest-VolumesNegativeTest-1896847921 tempest-VolumesNegativeTest-1896847921-project] Calling method '.version_select at 0x7f621fda9ca0>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:01.883995 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.wsgi [None req-1111d9fd-569d-467c-977e-ecbf9729f60f tempest-VolumesNegativeTest-1896847921 tempest-VolumesNegativeTest-1896847921-project] HTTP exception thrown: Volume tempest-invalid-180918739 could not be found. Sep 30 19:29:01.890452 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-1111d9fd-569d-467c-977e-ecbf9729f60f tempest-VolumesNegativeTest-1896847921 tempest-VolumesNegativeTest-1896847921-project] Request method failure captured: Sep 30 19:29:01.890452 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-180918739 HTTP/1.1 Sep 30 19:29:01.890452 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 30 19:29:01.890452 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 30 19:29:01.890452 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Connection: close Sep 30 19:29:01.890452 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Length: 0 Sep 30 19:29:01.890452 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 30 19:29:01.890452 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Host: 10.222.0.17 Sep 30 19:29:01.890452 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 30 19:29:01.890452 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 30 19:29:01.890452 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjN0N7Osiw3JIPN3ccTtB_SWreuc2kxYENW1WB2NGv2LCfMpnkzzru3QmX4u4HdPOQOEq4EzfhNbewmw4bitLpu4MHD40bsXRmoOrYlh8txf5PjkHwCaGON6Vmrn_K7V1HHSn6Wc-Zi2uCdum87KQ7bFAu-dNFJV75wxx3ZaQ3ZzRMSo8 Sep 30 19:29:01.890452 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 30 19:29:01.890452 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 30 19:29:01.890452 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 30 19:29:01.890452 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 30 19:29:01.890452 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 30 19:29:01.890452 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 30 19:29:01.890452 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Id: 1a4bb3c6a6714a1daae48c35f9b85aba Sep 30 19:29:01.890452 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-VolumesNegativeTest-1896847921 Sep 30 19:29:01.890452 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 30 19:29:01.890452 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 30 19:29:01.891803 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1a4bb3c6a6714a1daae48c35f9b85aba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1a4bb3c6a6714a1daae48c35f9b85aba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1a4bb3c6a6714a1daae48c35f9b85aba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1a4bb3c6a6714a1daae48c35f9b85aba"}]}] Sep 30 19:29:01.891803 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-VolumesNegativeTest-1896847921 Sep 30 19:29:01.891803 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Id: 1a4bb3c6a6714a1daae48c35f9b85aba Sep 30 19:29:01.891803 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-VolumesNegativeTest-1896847921 Sep 30 19:29:01.891803 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User: tempest-VolumesNegativeTest-1896847921-project Sep 30 19:29:01.891803 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 30 19:29:01.891803 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 30 19:29:01.891803 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Id: 144feda2a2474edfa8dc3e25ae3074b2 Sep 30 19:29:01.891803 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-VolumesNegativeTest-1896847921-project Sep 30 19:29:01.891803 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: method: Sep 30 19:29:01.891803 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: exception: Volume tempest-invalid-180918739 could not be found. Sep 30 19:29:01.891803 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: action_args: {'id': 'tempest-invalid-180918739'} Sep 30 19:29:01.891803 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:29:01.892794 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:29:01.892794 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 30 19:29:01.892794 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 30 19:29:01.892794 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 30 19:29:01.892794 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 30 19:29:01.892794 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 30 19:29:01.892794 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 30 19:29:01.892794 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 30 19:29:01.892794 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 30 19:29:01.892794 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 30 19:29:01.892794 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 30 19:29:01.892794 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 30 19:29:01.892794 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 30 19:29:01.892794 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 30 19:29:01.892794 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 30 19:29:01.892794 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-180918739 could not be found. (HTTP 404) (Request-ID: req-186aea03-e84e-46bf-9316-743b81476bdd) Sep 30 19:29:01.892794 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:01.892794 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:29:01.892794 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:01.894094 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:29:01.894094 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 30 19:29:01.894094 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 30 19:29:01.894094 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 30 19:29:01.894094 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 30 19:29:01.894094 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 30 19:29:01.894094 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 30 19:29:01.894094 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 30 19:29:01.894094 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 30 19:29:01.894094 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 30 19:29:01.894094 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 30 19:29:01.894094 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 30 19:29:01.894094 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 30 19:29:01.894094 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 30 19:29:01.894094 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 30 19:29:01.894094 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 30 19:29:01.894094 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 30 19:29:01.894094 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 30 19:29:01.894094 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 30 19:29:01.895361 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 30 19:29:01.895361 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 30 19:29:01.895361 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 30 19:29:01.895361 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 30 19:29:01.895361 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-180918739 could not be found. Sep 30 19:29:01.895361 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:01.895361 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:29:01.895361 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:01.895361 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:29:01.895361 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:29:01.895361 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:29:01.895361 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:29:01.895361 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:29:01.895361 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 30 19:29:01.895361 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 30 19:29:01.895361 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:29:01.895361 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:29:01.895361 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 30 19:29:01.895361 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 30 19:29:01.895361 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-180918739 could not be found. Sep 30 19:29:01.897808 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:01.897808 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:29:01.897808 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:01.897808 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:29:01.897808 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:29:01.897808 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:29:01.897808 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:29:01.897808 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:29:01.897808 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-180918739 could not be found. Sep 30 19:29:01.897808 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:01.897808 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-1111d9fd-569d-467c-977e-ecbf9729f60f tempest-VolumesNegativeTest-1896847921 tempest-VolumesNegativeTest-1896847921-project] Returning 404 to user: Volume tempest-invalid-180918739 could not be found. {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:29:01.903789 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-1111d9fd-569d-467c-977e-ecbf9729f60f tempest-VolumesNegativeTest-1896847921 tempest-VolumesNegativeTest-1896847921-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/tempest-invalid-180918739" status: 404 len: 98 microversion: 2.1 time: 0.373462 Sep 30 19:29:01.903789 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 4/4] 10.222.0.17 () {58 vars in 1215 bytes} [Fri Sep 30 19:29:01 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-180918739 => generated 98 bytes in 375 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 30 19:29:01.925878 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-4397cc9d-243d-4fd9-846e-dce1d3624925 tempest-VolumesNegativeTest-1896847921 tempest-VolumesNegativeTest-1896847921-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.011930 Sep 30 19:29:01.928915 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 5/5] 10.222.0.17 () {58 vars in 1140 bytes} [Fri Sep 30 19:29:01 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 30 19:29:01.946215 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-50d121c1-2bcf-4824-99c5-810f44700937 tempest-VolumesNegativeTest-1896847921 tempest-VolumesNegativeTest-1896847921-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006866 Sep 30 19:29:01.947139 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 6/6] 10.222.0.17 () {58 vars in 1137 bytes} [Fri Sep 30 19:29:01 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 30 19:29:01.963960 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-f60131ea-e7d1-4f02-8600-d9c0e826de28 tempest-VolumesNegativeTest-1896847921 tempest-VolumesNegativeTest-1896847921-project] Calling method '.version_select at 0x7f621fd2eee0>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:02.030720 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.wsgi [None req-f60131ea-e7d1-4f02-8600-d9c0e826de28 tempest-VolumesNegativeTest-1896847921 tempest-VolumesNegativeTest-1896847921-project] HTTP exception thrown: Volume a4c0fd8a-1f01-440e-8656-1041a3e35975 could not be found. Sep 30 19:29:02.033787 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-f60131ea-e7d1-4f02-8600-d9c0e826de28 tempest-VolumesNegativeTest-1896847921 tempest-VolumesNegativeTest-1896847921-project] Request method failure captured: Sep 30 19:29:02.033787 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: request: DELETE /compute/v2.1/os-volumes/a4c0fd8a-1f01-440e-8656-1041a3e35975 HTTP/1.1 Sep 30 19:29:02.033787 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 30 19:29:02.033787 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 30 19:29:02.033787 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Connection: close Sep 30 19:29:02.033787 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Length: 0 Sep 30 19:29:02.033787 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 30 19:29:02.033787 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Host: 10.222.0.17 Sep 30 19:29:02.033787 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 30 19:29:02.033787 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 30 19:29:02.033787 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjN0N7Osiw3JIPN3ccTtB_SWreuc2kxYENW1WB2NGv2LCfMpnkzzru3QmX4u4HdPOQOEq4EzfhNbewmw4bitLpu4MHD40bsXRmoOrYlh8txf5PjkHwCaGON6Vmrn_K7V1HHSn6Wc-Zi2uCdum87KQ7bFAu-dNFJV75wxx3ZaQ3ZzRMSo8 Sep 30 19:29:02.033787 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 30 19:29:02.033787 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 30 19:29:02.033787 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 30 19:29:02.033787 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 30 19:29:02.033787 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 30 19:29:02.033787 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 30 19:29:02.033787 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Id: 1a4bb3c6a6714a1daae48c35f9b85aba Sep 30 19:29:02.033787 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-VolumesNegativeTest-1896847921 Sep 30 19:29:02.033787 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 30 19:29:02.033787 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 30 19:29:02.035986 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1a4bb3c6a6714a1daae48c35f9b85aba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1a4bb3c6a6714a1daae48c35f9b85aba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1a4bb3c6a6714a1daae48c35f9b85aba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1a4bb3c6a6714a1daae48c35f9b85aba"}]}] Sep 30 19:29:02.035986 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-VolumesNegativeTest-1896847921 Sep 30 19:29:02.035986 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Id: 1a4bb3c6a6714a1daae48c35f9b85aba Sep 30 19:29:02.035986 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-VolumesNegativeTest-1896847921 Sep 30 19:29:02.035986 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User: tempest-VolumesNegativeTest-1896847921-project Sep 30 19:29:02.035986 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 30 19:29:02.035986 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 30 19:29:02.035986 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Id: 144feda2a2474edfa8dc3e25ae3074b2 Sep 30 19:29:02.035986 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-VolumesNegativeTest-1896847921-project Sep 30 19:29:02.035986 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: method: Sep 30 19:29:02.035986 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: exception: Volume a4c0fd8a-1f01-440e-8656-1041a3e35975 could not be found. Sep 30 19:29:02.035986 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: action_args: {'id': 'a4c0fd8a-1f01-440e-8656-1041a3e35975'} Sep 30 19:29:02.035986 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:29:02.036975 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:29:02.036975 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 30 19:29:02.036975 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 30 19:29:02.036975 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 30 19:29:02.036975 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 30 19:29:02.036975 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 30 19:29:02.036975 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 30 19:29:02.036975 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 30 19:29:02.036975 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 30 19:29:02.036975 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 30 19:29:02.036975 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 30 19:29:02.036975 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 30 19:29:02.036975 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 30 19:29:02.036975 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 30 19:29:02.036975 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 30 19:29:02.036975 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a4c0fd8a-1f01-440e-8656-1041a3e35975 could not be found. (HTTP 404) (Request-ID: req-9663bb1b-c890-4bc5-853d-6ec75a5ea7bf) Sep 30 19:29:02.036975 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:02.036975 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:29:02.036975 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:02.039553 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:29:02.039553 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 30 19:29:02.039553 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 30 19:29:02.039553 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 30 19:29:02.039553 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 30 19:29:02.039553 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 30 19:29:02.039553 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 30 19:29:02.039553 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 30 19:29:02.039553 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 30 19:29:02.039553 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 30 19:29:02.039553 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 30 19:29:02.039553 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 30 19:29:02.039553 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 30 19:29:02.039553 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 30 19:29:02.039553 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 30 19:29:02.039553 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 30 19:29:02.039553 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 30 19:29:02.039553 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 30 19:29:02.039553 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 30 19:29:02.042829 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 30 19:29:02.042829 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 30 19:29:02.042829 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 30 19:29:02.042829 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 30 19:29:02.042829 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a4c0fd8a-1f01-440e-8656-1041a3e35975 could not be found. Sep 30 19:29:02.042829 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:02.042829 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:29:02.042829 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:02.042829 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:29:02.042829 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:29:02.042829 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:29:02.042829 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:29:02.042829 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:29:02.042829 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 30 19:29:02.042829 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 30 19:29:02.042829 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:29:02.042829 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:29:02.042829 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 30 19:29:02.042829 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 30 19:29:02.046625 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a4c0fd8a-1f01-440e-8656-1041a3e35975 could not be found. Sep 30 19:29:02.046625 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:02.046625 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:29:02.046625 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:02.046625 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:29:02.046625 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:29:02.046625 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:29:02.046625 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:29:02.046625 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:29:02.046625 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a4c0fd8a-1f01-440e-8656-1041a3e35975 could not be found. Sep 30 19:29:02.046625 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:02.049759 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-f60131ea-e7d1-4f02-8600-d9c0e826de28 tempest-VolumesNegativeTest-1896847921 tempest-VolumesNegativeTest-1896847921-project] Returning 404 to user: Volume a4c0fd8a-1f01-440e-8656-1041a3e35975 could not be found. {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:29:02.051199 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-f60131ea-e7d1-4f02-8600-d9c0e826de28 tempest-VolumesNegativeTest-1896847921 tempest-VolumesNegativeTest-1896847921-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/a4c0fd8a-1f01-440e-8656-1041a3e35975" status: 404 len: 109 microversion: 2.1 time: 0.095021 Sep 30 19:29:02.052081 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 7/7] 10.222.0.17 () {58 vars in 1248 bytes} [Fri Sep 30 19:29:01 2022] DELETE /compute/v2.1/os-volumes/a4c0fd8a-1f01-440e-8656-1041a3e35975 => generated 109 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 30 19:29:02.084523 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-132dae84-2955-49ef-8aed-ca2a4ac158cb tempest-VolumesNegativeTest-1896847921 tempest-VolumesNegativeTest-1896847921-project] Calling method '.version_select at 0x7f621fce0700>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:02.164872 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.wsgi [None req-132dae84-2955-49ef-8aed-ca2a4ac158cb tempest-VolumesNegativeTest-1896847921 tempest-VolumesNegativeTest-1896847921-project] HTTP exception thrown: Volume 7219bf33-fea2-47b8-95aa-6a3166293081 could not be found. Sep 30 19:29:02.167934 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-132dae84-2955-49ef-8aed-ca2a4ac158cb tempest-VolumesNegativeTest-1896847921 tempest-VolumesNegativeTest-1896847921-project] Request method failure captured: Sep 30 19:29:02.167934 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: request: GET /compute/v2.1/os-volumes/7219bf33-fea2-47b8-95aa-6a3166293081 HTTP/1.1 Sep 30 19:29:02.167934 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 30 19:29:02.167934 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 30 19:29:02.167934 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Connection: close Sep 30 19:29:02.167934 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Length: 0 Sep 30 19:29:02.167934 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 30 19:29:02.167934 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Host: 10.222.0.17 Sep 30 19:29:02.167934 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 30 19:29:02.167934 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 30 19:29:02.167934 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjN0N7Osiw3JIPN3ccTtB_SWreuc2kxYENW1WB2NGv2LCfMpnkzzru3QmX4u4HdPOQOEq4EzfhNbewmw4bitLpu4MHD40bsXRmoOrYlh8txf5PjkHwCaGON6Vmrn_K7V1HHSn6Wc-Zi2uCdum87KQ7bFAu-dNFJV75wxx3ZaQ3ZzRMSo8 Sep 30 19:29:02.167934 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 30 19:29:02.167934 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 30 19:29:02.167934 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 30 19:29:02.167934 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 30 19:29:02.167934 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 30 19:29:02.167934 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 30 19:29:02.167934 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Id: 1a4bb3c6a6714a1daae48c35f9b85aba Sep 30 19:29:02.167934 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-VolumesNegativeTest-1896847921 Sep 30 19:29:02.167934 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 30 19:29:02.167934 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 30 19:29:02.169529 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1a4bb3c6a6714a1daae48c35f9b85aba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1a4bb3c6a6714a1daae48c35f9b85aba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1a4bb3c6a6714a1daae48c35f9b85aba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1a4bb3c6a6714a1daae48c35f9b85aba"}]}] Sep 30 19:29:02.169529 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-VolumesNegativeTest-1896847921 Sep 30 19:29:02.169529 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Id: 1a4bb3c6a6714a1daae48c35f9b85aba Sep 30 19:29:02.169529 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-VolumesNegativeTest-1896847921 Sep 30 19:29:02.169529 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User: tempest-VolumesNegativeTest-1896847921-project Sep 30 19:29:02.169529 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 30 19:29:02.169529 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 30 19:29:02.169529 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Id: 144feda2a2474edfa8dc3e25ae3074b2 Sep 30 19:29:02.169529 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-VolumesNegativeTest-1896847921-project Sep 30 19:29:02.169529 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: method: Sep 30 19:29:02.169529 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: exception: Volume 7219bf33-fea2-47b8-95aa-6a3166293081 could not be found. Sep 30 19:29:02.169529 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: action_args: {'id': '7219bf33-fea2-47b8-95aa-6a3166293081'} Sep 30 19:29:02.169529 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:29:02.170501 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:29:02.170501 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 30 19:29:02.170501 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 30 19:29:02.170501 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 30 19:29:02.170501 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 30 19:29:02.170501 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 30 19:29:02.170501 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 30 19:29:02.170501 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 30 19:29:02.170501 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 30 19:29:02.170501 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 30 19:29:02.170501 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 30 19:29:02.170501 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 30 19:29:02.170501 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 30 19:29:02.170501 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 30 19:29:02.170501 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 30 19:29:02.170501 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7219bf33-fea2-47b8-95aa-6a3166293081 could not be found. (HTTP 404) (Request-ID: req-676d8e1e-b80b-4496-83fa-06c67d29d2ec) Sep 30 19:29:02.170501 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:02.170501 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:29:02.170501 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:02.171935 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:29:02.171935 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 30 19:29:02.171935 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 30 19:29:02.171935 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 30 19:29:02.171935 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 30 19:29:02.171935 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 30 19:29:02.171935 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 30 19:29:02.171935 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 30 19:29:02.171935 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 30 19:29:02.171935 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 30 19:29:02.171935 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 30 19:29:02.171935 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 30 19:29:02.171935 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 30 19:29:02.171935 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 30 19:29:02.171935 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 30 19:29:02.171935 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 30 19:29:02.171935 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 30 19:29:02.171935 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 30 19:29:02.171935 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 30 19:29:02.174166 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 30 19:29:02.174166 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 30 19:29:02.174166 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 30 19:29:02.174166 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 30 19:29:02.174166 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7219bf33-fea2-47b8-95aa-6a3166293081 could not be found. Sep 30 19:29:02.174166 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:02.174166 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:29:02.174166 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:02.174166 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:29:02.174166 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:29:02.174166 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:29:02.174166 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:29:02.174166 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:29:02.174166 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 30 19:29:02.174166 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 30 19:29:02.174166 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:29:02.174166 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:29:02.174166 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 30 19:29:02.174166 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 30 19:29:02.185244 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7219bf33-fea2-47b8-95aa-6a3166293081 could not be found. Sep 30 19:29:02.185244 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:02.185244 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:29:02.185244 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:02.185244 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:29:02.185244 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:29:02.185244 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:29:02.185244 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:29:02.185244 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:29:02.185244 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7219bf33-fea2-47b8-95aa-6a3166293081 could not be found. Sep 30 19:29:02.185244 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:02.185244 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-132dae84-2955-49ef-8aed-ca2a4ac158cb tempest-VolumesNegativeTest-1896847921 tempest-VolumesNegativeTest-1896847921-project] Returning 404 to user: Volume 7219bf33-fea2-47b8-95aa-6a3166293081 could not be found. {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:29:02.185244 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-132dae84-2955-49ef-8aed-ca2a4ac158cb tempest-VolumesNegativeTest-1896847921 tempest-VolumesNegativeTest-1896847921-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/7219bf33-fea2-47b8-95aa-6a3166293081" status: 404 len: 109 microversion: 2.1 time: 0.116008 Sep 30 19:29:02.185244 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 8/8] 10.222.0.17 () {58 vars in 1245 bytes} [Fri Sep 30 19:29:02 2022] GET /compute/v2.1/os-volumes/7219bf33-fea2-47b8-95aa-6a3166293081 => generated 109 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 30 19:29:02.229112 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-aaf94942-23d3-4108-9824-0c39563cc007 tempest-VolumesSnapshotsTestJSON-404884988 tempest-VolumesSnapshotsTestJSON-404884988-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.197626 Sep 30 19:29:02.230635 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 1/9] 10.222.0.17 () {60 vars in 1155 bytes} [Fri Sep 30 19:29:00 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 2201 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 30 19:29:02.245585 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-996d4e9a-b77d-4461-99f0-fd5eafb25fad tempest-VolumesSnapshotsTestJSON-404884988 tempest-VolumesSnapshotsTestJSON-404884988-project] Calling method '.version_select at 0x7f621fd2edc0>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:02.422962 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-996d4e9a-b77d-4461-99f0-fd5eafb25fad tempest-VolumesSnapshotsTestJSON-404884988 tempest-VolumesSnapshotsTestJSON-404884988-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/a2a6423a-fe27-4d13-b81a-dd43ec5b73f5" status: 200 len: 344 microversion: 2.1 time: 0.181347 Sep 30 19:29:02.423738 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 9/10] 10.222.0.17 () {58 vars in 1245 bytes} [Fri Sep 30 19:29:02 2022] GET /compute/v2.1/os-volumes/a2a6423a-fe27-4d13-b81a-dd43ec5b73f5 => generated 344 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 30 19:29:03.450630 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-a9ce9249-ea24-46d5-b544-08a88bc4f2c7 tempest-VolumesSnapshotsTestJSON-404884988 tempest-VolumesSnapshotsTestJSON-404884988-project] Calling method '.version_select at 0x7f621fdc44c0>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:03.597642 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-a9ce9249-ea24-46d5-b544-08a88bc4f2c7 tempest-VolumesSnapshotsTestJSON-404884988 tempest-VolumesSnapshotsTestJSON-404884988-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/a2a6423a-fe27-4d13-b81a-dd43ec5b73f5" status: 200 len: 345 microversion: 2.1 time: 0.163078 Sep 30 19:29:03.600024 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 2/11] 10.222.0.17 () {58 vars in 1245 bytes} [Fri Sep 30 19:29:03 2022] GET /compute/v2.1/os-volumes/a2a6423a-fe27-4d13-b81a-dd43ec5b73f5 => generated 345 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:29:03.604556 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-3998b63a-a625-4423-99d1-59290c9b3df9 tempest-VolumesTestJSON-1280965431 tempest-VolumesTestJSON-1280965431-project] Calling method '.version_select at 0x7f621fce05e0>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:03.614363 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-9281dc91-ebfd-48b7-a3a1-8f2af9dd1992 tempest-VolumesSnapshotsTestJSON-404884988 tempest-VolumesSnapshotsTestJSON-404884988-project] Action: 'create', calling method: .version_select at 0x7f621fdc4af0>, body: {"snapshot": {"volume_id": "a2a6423a-fe27-4d13-b81a-dd43ec5b73f5", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1036097793"}} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:29:03.710400 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-3998b63a-a625-4423-99d1-59290c9b3df9 tempest-VolumesTestJSON-1280965431 tempest-VolumesTestJSON-1280965431-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/c5173d79-8315-40b6-9839-13ee6644b973" status: 200 len: 351 microversion: 2.1 time: 0.110172 Sep 30 19:29:03.711060 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 10/12] 10.222.0.17 () {58 vars in 1245 bytes} [Fri Sep 30 19:29:03 2022] GET /compute/v2.1/os-volumes/c5173d79-8315-40b6-9839-13ee6644b973 => generated 351 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:29:04.173539 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-9281dc91-ebfd-48b7-a3a1-8f2af9dd1992 tempest-VolumesSnapshotsTestJSON-404884988 tempest-VolumesSnapshotsTestJSON-404884988-project] 10.222.0.17 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.565329 Sep 30 19:29:04.174480 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 3/13] 10.222.0.17 () {60 vars in 1162 bytes} [Fri Sep 30 19:29:03 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:29:04.186425 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-2be149ad-d593-410a-89b7-c0e009884bf3 tempest-VolumesSnapshotsTestJSON-404884988 tempest-VolumesSnapshotsTestJSON-404884988-project] Calling method '.version_select at 0x7f621fceb1f0>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:04.232923 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-2be149ad-d593-410a-89b7-c0e009884bf3 tempest-VolumesSnapshotsTestJSON-404884988 tempest-VolumesSnapshotsTestJSON-404884988-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/e1a5582d-3b1d-4b99-a604-33929bab8476" status: 200 len: 287 microversion: 2.1 time: 0.050974 Sep 30 19:29:04.234250 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 11/14] 10.222.0.17 () {58 vars in 1251 bytes} [Fri Sep 30 19:29:04 2022] GET /compute/v2.1/os-snapshots/e1a5582d-3b1d-4b99-a604-33929bab8476 => generated 287 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:29:04.246928 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-ae05c5fc-5be9-489c-8748-450bf9f1e48a tempest-VolumesSnapshotsTestJSON-404884988 tempest-VolumesSnapshotsTestJSON-404884988-project] Calling method '.version_select at 0x7f621fd58dc0>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:04.346415 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-ae05c5fc-5be9-489c-8748-450bf9f1e48a tempest-VolumesSnapshotsTestJSON-404884988 tempest-VolumesSnapshotsTestJSON-404884988-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.104729 Sep 30 19:29:04.347635 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 4/15] 10.222.0.17 () {58 vars in 1140 bytes} [Fri Sep 30 19:29:04 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:29:04.359267 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-5ddbbfe6-9db6-4ff6-bc62-235b6a462f9f tempest-VolumesSnapshotsTestJSON-404884988 tempest-VolumesSnapshotsTestJSON-404884988-project] Calling method '.version_select at 0x7f621fce0790>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:04.408961 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-5ddbbfe6-9db6-4ff6-bc62-235b6a462f9f tempest-VolumesSnapshotsTestJSON-404884988 tempest-VolumesSnapshotsTestJSON-404884988-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/e1a5582d-3b1d-4b99-a604-33929bab8476" status: 200 len: 287 microversion: 2.1 time: 0.053623 Sep 30 19:29:04.410722 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 12/16] 10.222.0.17 () {58 vars in 1251 bytes} [Fri Sep 30 19:29:04 2022] GET /compute/v2.1/os-snapshots/e1a5582d-3b1d-4b99-a604-33929bab8476 => generated 287 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:29:05.425099 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-b5e2981e-8e0e-4bfa-a97f-52291fa0f224 tempest-VolumesSnapshotsTestJSON-404884988 tempest-VolumesSnapshotsTestJSON-404884988-project] Calling method '.version_select at 0x7f622071db80>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:05.466233 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-b5e2981e-8e0e-4bfa-a97f-52291fa0f224 tempest-VolumesSnapshotsTestJSON-404884988 tempest-VolumesSnapshotsTestJSON-404884988-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/e1a5582d-3b1d-4b99-a604-33929bab8476" status: 200 len: 287 microversion: 2.1 time: 0.046872 Sep 30 19:29:05.467897 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 5/17] 10.222.0.17 () {58 vars in 1251 bytes} [Fri Sep 30 19:29:05 2022] GET /compute/v2.1/os-snapshots/e1a5582d-3b1d-4b99-a604-33929bab8476 => generated 287 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:29:06.482316 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-dfaaa319-3874-472a-9038-1406c0917eae tempest-VolumesSnapshotsTestJSON-404884988 tempest-VolumesSnapshotsTestJSON-404884988-project] Calling method '.version_select at 0x7f621fd2ef70>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:06.536723 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-dfaaa319-3874-472a-9038-1406c0917eae tempest-VolumesSnapshotsTestJSON-404884988 tempest-VolumesSnapshotsTestJSON-404884988-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/e1a5582d-3b1d-4b99-a604-33929bab8476" status: 200 len: 287 microversion: 2.1 time: 0.060113 Sep 30 19:29:06.537728 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 13/18] 10.222.0.17 () {58 vars in 1251 bytes} [Fri Sep 30 19:29:06 2022] GET /compute/v2.1/os-snapshots/e1a5582d-3b1d-4b99-a604-33929bab8476 => generated 287 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:29:07.550192 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-8a891b6c-4340-46f5-864b-40abc2fb0d14 tempest-VolumesSnapshotsTestJSON-404884988 tempest-VolumesSnapshotsTestJSON-404884988-project] Calling method '.version_select at 0x7f621fdc4af0>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:07.623773 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-8a891b6c-4340-46f5-864b-40abc2fb0d14 tempest-VolumesSnapshotsTestJSON-404884988 tempest-VolumesSnapshotsTestJSON-404884988-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/e1a5582d-3b1d-4b99-a604-33929bab8476" status: 200 len: 287 microversion: 2.1 time: 0.077101 Sep 30 19:29:07.629160 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 6/19] 10.222.0.17 () {58 vars in 1251 bytes} [Fri Sep 30 19:29:07 2022] GET /compute/v2.1/os-snapshots/e1a5582d-3b1d-4b99-a604-33929bab8476 => generated 287 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:29:08.636944 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-80afb639-4582-49f2-97a9-4859d8f36dbf tempest-VolumesSnapshotsTestJSON-404884988 tempest-VolumesSnapshotsTestJSON-404884988-project] Calling method '.version_select at 0x7f621fceb3a0>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:08.693315 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-80afb639-4582-49f2-97a9-4859d8f36dbf tempest-VolumesSnapshotsTestJSON-404884988 tempest-VolumesSnapshotsTestJSON-404884988-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/e1a5582d-3b1d-4b99-a604-33929bab8476" status: 200 len: 287 microversion: 2.1 time: 0.060102 Sep 30 19:29:08.693888 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 14/20] 10.222.0.17 () {58 vars in 1251 bytes} [Fri Sep 30 19:29:08 2022] GET /compute/v2.1/os-snapshots/e1a5582d-3b1d-4b99-a604-33929bab8476 => generated 287 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:29:09.714428 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-a813a739-284b-4a73-b0fb-3756d3e8aeaa tempest-VolumesSnapshotsTestJSON-404884988 tempest-VolumesSnapshotsTestJSON-404884988-project] Calling method '.version_select at 0x7f621fdc4430>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:09.781297 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-a813a739-284b-4a73-b0fb-3756d3e8aeaa tempest-VolumesSnapshotsTestJSON-404884988 tempest-VolumesSnapshotsTestJSON-404884988-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/e1a5582d-3b1d-4b99-a604-33929bab8476" status: 200 len: 287 microversion: 2.1 time: 0.076421 Sep 30 19:29:09.782805 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 7/21] 10.222.0.17 () {58 vars in 1251 bytes} [Fri Sep 30 19:29:09 2022] GET /compute/v2.1/os-snapshots/e1a5582d-3b1d-4b99-a604-33929bab8476 => generated 287 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:29:10.794954 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-64d3994c-8ad2-4d01-9373-ce69d0f2c99b tempest-VolumesSnapshotsTestJSON-404884988 tempest-VolumesSnapshotsTestJSON-404884988-project] Calling method '.version_select at 0x7f621fceb9d0>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:10.923541 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-64d3994c-8ad2-4d01-9373-ce69d0f2c99b tempest-VolumesSnapshotsTestJSON-404884988 tempest-VolumesSnapshotsTestJSON-404884988-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/e1a5582d-3b1d-4b99-a604-33929bab8476" status: 200 len: 287 microversion: 2.1 time: 0.132140 Sep 30 19:29:10.924102 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 15/22] 10.222.0.17 () {58 vars in 1251 bytes} [Fri Sep 30 19:29:10 2022] GET /compute/v2.1/os-snapshots/e1a5582d-3b1d-4b99-a604-33929bab8476 => generated 287 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:29:11.792472 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-dabd524a-9fc8-4155-bb2b-ec940b5b90b3 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1936520150", "imageRef": "7714d055-7d2c-4f56-9b14-45324361e286", "flavorRef": "452", "networks": [{"uuid": "92ac2f3a-2065-4b76-a818-a3b4099a846b"}]}} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:29:11.943036 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-11af1750-ede1-41a3-904b-7a97cf39fff5 tempest-VolumesSnapshotsTestJSON-404884988 tempest-VolumesSnapshotsTestJSON-404884988-project] Calling method '.version_select at 0x7f621fd2e9d0>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:12.015440 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.network.neutron [None req-dabd524a-9fc8-4155-bb2b-ec940b5b90b3 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] validate_networks() for [('92ac2f3a-2065-4b76-a818-a3b4099a846b', None, None, None, None, None)] {{(pid=120649) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 30 19:29:12.023873 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-11af1750-ede1-41a3-904b-7a97cf39fff5 tempest-VolumesSnapshotsTestJSON-404884988 tempest-VolumesSnapshotsTestJSON-404884988-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/e1a5582d-3b1d-4b99-a604-33929bab8476" status: 200 len: 288 microversion: 2.1 time: 0.087338 Sep 30 19:29:12.031480 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 16/23] 10.222.0.17 () {58 vars in 1251 bytes} [Fri Sep 30 19:29:11 2022] GET /compute/v2.1/os-snapshots/e1a5582d-3b1d-4b99-a604-33929bab8476 => generated 288 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:29:12.037797 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-7cdf7374-b63d-485f-9a5c-89f4844192e5 tempest-VolumesSnapshotsTestJSON-404884988 tempest-VolumesSnapshotsTestJSON-404884988-project] Calling method '.version_select at 0x7f621fce09d0>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:12.171713 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-7cdf7374-b63d-485f-9a5c-89f4844192e5 tempest-VolumesSnapshotsTestJSON-404884988 tempest-VolumesSnapshotsTestJSON-404884988-project] 10.222.0.17 "DELETE /compute/v2.1/os-snapshots/e1a5582d-3b1d-4b99-a604-33929bab8476" status: 202 len: 0 microversion: 2.1 time: 0.139051 Sep 30 19:29:12.172404 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 17/24] 10.222.0.17 () {58 vars in 1254 bytes} [Fri Sep 30 19:29:12 2022] DELETE /compute/v2.1/os-snapshots/e1a5582d-3b1d-4b99-a604-33929bab8476 => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 30 19:29:12.180660 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-2d6f5f29-7338-4cd1-941a-1477901ef3e6 tempest-VolumesSnapshotsTestJSON-404884988 tempest-VolumesSnapshotsTestJSON-404884988-project] Calling method '.version_select at 0x7f621fcebc10>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:12.236191 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-2d6f5f29-7338-4cd1-941a-1477901ef3e6 tempest-VolumesSnapshotsTestJSON-404884988 tempest-VolumesSnapshotsTestJSON-404884988-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/e1a5582d-3b1d-4b99-a604-33929bab8476" status: 200 len: 287 microversion: 2.1 time: 0.059458 Sep 30 19:29:12.237622 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 18/25] 10.222.0.17 () {58 vars in 1251 bytes} [Fri Sep 30 19:29:12 2022] GET /compute/v2.1/os-snapshots/e1a5582d-3b1d-4b99-a604-33929bab8476 => generated 287 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:29:12.405639 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-ea429590-51d4-46f8-b842-3f278be8d6a1 tempest-VolumesTestJSON-1280965431 tempest-VolumesTestJSON-1280965431-project] Calling method '.version_select at 0x7f621fce0430>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:12.478513 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-ea429590-51d4-46f8-b842-3f278be8d6a1 tempest-VolumesTestJSON-1280965431 tempest-VolumesTestJSON-1280965431-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/65abc19d-a941-4b23-87d3-030b28ad071e" status: 200 len: 351 microversion: 2.1 time: 0.077580 Sep 30 19:29:12.479074 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 19/26] 10.222.0.17 () {58 vars in 1245 bytes} [Fri Sep 30 19:29:12 2022] GET /compute/v2.1/os-volumes/65abc19d-a941-4b23-87d3-030b28ad071e => generated 351 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 30 19:29:13.251477 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-2220ca05-1699-4206-8a5e-993677a39f62 tempest-VolumesSnapshotsTestJSON-404884988 tempest-VolumesSnapshotsTestJSON-404884988-project] Calling method '.version_select at 0x7f621fd2ec10>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:13.314758 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.wsgi [None req-2220ca05-1699-4206-8a5e-993677a39f62 tempest-VolumesSnapshotsTestJSON-404884988 tempest-VolumesSnapshotsTestJSON-404884988-project] HTTP exception thrown: Snapshot e1a5582d-3b1d-4b99-a604-33929bab8476 could not be found. Sep 30 19:29:13.320895 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-2220ca05-1699-4206-8a5e-993677a39f62 tempest-VolumesSnapshotsTestJSON-404884988 tempest-VolumesSnapshotsTestJSON-404884988-project] Request method failure captured: Sep 30 19:29:13.320895 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: request: GET /compute/v2.1/os-snapshots/e1a5582d-3b1d-4b99-a604-33929bab8476 HTTP/1.1 Sep 30 19:29:13.320895 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 30 19:29:13.320895 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 30 19:29:13.320895 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Connection: close Sep 30 19:29:13.320895 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Length: 0 Sep 30 19:29:13.320895 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 30 19:29:13.320895 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Host: 10.222.0.17 Sep 30 19:29:13.320895 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 30 19:29:13.320895 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 30 19:29:13.320895 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjN0N7_eMv2unRymyVNynJUEe3QJvsWMSapXnAOYkhF3DkioozvSN4wRnC17VXjADtuoLLF1_p_EEzK74IqEfJ4_lsafGoD25ro33-79vSOi8Mc5NvFdGPc7IECx11Rn6jajlXoO2AQnJEPS8KKDa26hXWprHXfYViGpEo_4ngoVfZuDo Sep 30 19:29:13.320895 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 30 19:29:13.320895 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 30 19:29:13.320895 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 30 19:29:13.320895 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 30 19:29:13.320895 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 30 19:29:13.320895 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 30 19:29:13.320895 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Id: d9f37085e1ca47a88dc01edd217a9805 Sep 30 19:29:13.320895 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-404884988 Sep 30 19:29:13.320895 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 30 19:29:13.320895 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 30 19:29:13.322163 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d9f37085e1ca47a88dc01edd217a9805"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d9f37085e1ca47a88dc01edd217a9805"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d9f37085e1ca47a88dc01edd217a9805"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d9f37085e1ca47a88dc01edd217a9805"}]}] Sep 30 19:29:13.322163 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-VolumesSnapshotsTestJSON-404884988 Sep 30 19:29:13.322163 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Id: d9f37085e1ca47a88dc01edd217a9805 Sep 30 19:29:13.322163 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-404884988 Sep 30 19:29:13.322163 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User: tempest-VolumesSnapshotsTestJSON-404884988-project Sep 30 19:29:13.322163 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 30 19:29:13.322163 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 30 19:29:13.322163 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Id: 4427e3b5656a407dbbf7608985a64ab8 Sep 30 19:29:13.322163 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-VolumesSnapshotsTestJSON-404884988-project Sep 30 19:29:13.322163 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: method: Sep 30 19:29:13.322163 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: exception: Snapshot e1a5582d-3b1d-4b99-a604-33929bab8476 could not be found. Sep 30 19:29:13.322163 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: action_args: {'id': 'e1a5582d-3b1d-4b99-a604-33929bab8476'} Sep 30 19:29:13.322163 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:29:13.322890 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:29:13.322890 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 30 19:29:13.322890 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 30 19:29:13.322890 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 30 19:29:13.322890 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 30 19:29:13.322890 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 30 19:29:13.322890 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 30 19:29:13.322890 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 30 19:29:13.322890 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 30 19:29:13.322890 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 30 19:29:13.322890 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 30 19:29:13.322890 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 30 19:29:13.322890 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 30 19:29:13.322890 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 30 19:29:13.322890 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 30 19:29:13.322890 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot e1a5582d-3b1d-4b99-a604-33929bab8476 could not be found. (HTTP 404) (Request-ID: req-d2cda0f7-5aa5-45bf-ae90-afb269717f74) Sep 30 19:29:13.322890 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:13.322890 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:29:13.323904 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:13.323904 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:29:13.323904 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 30 19:29:13.323904 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 30 19:29:13.323904 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 30 19:29:13.323904 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 30 19:29:13.323904 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 30 19:29:13.323904 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 30 19:29:13.323904 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 30 19:29:13.323904 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 30 19:29:13.323904 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 30 19:29:13.323904 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 30 19:29:13.323904 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 30 19:29:13.323904 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 30 19:29:13.323904 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 30 19:29:13.323904 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 30 19:29:13.323904 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 30 19:29:13.323904 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 30 19:29:13.323904 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 30 19:29:13.325037 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 30 19:29:13.325037 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 30 19:29:13.325037 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 30 19:29:13.325037 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 30 19:29:13.325037 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 30 19:29:13.325037 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot e1a5582d-3b1d-4b99-a604-33929bab8476 could not be found. Sep 30 19:29:13.325037 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:13.325037 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:29:13.325037 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:13.325037 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:29:13.325037 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:29:13.325037 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:29:13.325037 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:29:13.325037 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:29:13.325037 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 30 19:29:13.325037 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 30 19:29:13.325037 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:29:13.325037 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:29:13.325037 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 30 19:29:13.325037 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 30 19:29:13.327048 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot e1a5582d-3b1d-4b99-a604-33929bab8476 could not be found. Sep 30 19:29:13.327048 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:13.327048 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:29:13.327048 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:13.327048 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:29:13.327048 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:29:13.327048 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:29:13.327048 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:29:13.327048 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:29:13.327048 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot e1a5582d-3b1d-4b99-a604-33929bab8476 could not be found. Sep 30 19:29:13.327048 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:13.330073 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-2220ca05-1699-4206-8a5e-993677a39f62 tempest-VolumesSnapshotsTestJSON-404884988 tempest-VolumesSnapshotsTestJSON-404884988-project] Returning 404 to user: Snapshot e1a5582d-3b1d-4b99-a604-33929bab8476 could not be found. {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:29:13.333043 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-2220ca05-1699-4206-8a5e-993677a39f62 tempest-VolumesSnapshotsTestJSON-404884988 tempest-VolumesSnapshotsTestJSON-404884988-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/e1a5582d-3b1d-4b99-a604-33929bab8476" status: 404 len: 111 microversion: 2.1 time: 0.085445 Sep 30 19:29:13.336585 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 20/27] 10.222.0.17 () {58 vars in 1251 bytes} [Fri Sep 30 19:29:13 2022] GET /compute/v2.1/os-snapshots/e1a5582d-3b1d-4b99-a604-33929bab8476 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 30 19:29:13.361736 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-2a3c61bc-0a09-4a06-98d0-d795e25d34ff tempest-VolumesSnapshotsTestJSON-404884988 tempest-VolumesSnapshotsTestJSON-404884988-project] Calling method '.version_select at 0x7f621fd2edc0>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:13.529661 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-2a3c61bc-0a09-4a06-98d0-d795e25d34ff tempest-VolumesSnapshotsTestJSON-404884988 tempest-VolumesSnapshotsTestJSON-404884988-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/a2a6423a-fe27-4d13-b81a-dd43ec5b73f5" status: 202 len: 0 microversion: 2.1 time: 0.189542 Sep 30 19:29:13.530353 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 21/28] 10.222.0.17 () {58 vars in 1248 bytes} [Fri Sep 30 19:29:13 2022] DELETE /compute/v2.1/os-volumes/a2a6423a-fe27-4d13-b81a-dd43ec5b73f5 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 30 19:29:13.539547 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-962dd522-81d4-42c1-a207-1aa43ee3e402 tempest-VolumesSnapshotsTestJSON-404884988 tempest-VolumesSnapshotsTestJSON-404884988-project] Calling method '.version_select at 0x7f621fce0ee0>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:13.639282 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-962dd522-81d4-42c1-a207-1aa43ee3e402 tempest-VolumesSnapshotsTestJSON-404884988 tempest-VolumesSnapshotsTestJSON-404884988-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/a2a6423a-fe27-4d13-b81a-dd43ec5b73f5" status: 200 len: 344 microversion: 2.1 time: 0.104267 Sep 30 19:29:13.641218 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 22/29] 10.222.0.17 () {58 vars in 1245 bytes} [Fri Sep 30 19:29:13 2022] GET /compute/v2.1/os-volumes/a2a6423a-fe27-4d13-b81a-dd43ec5b73f5 => generated 344 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 30 19:29:14.599550 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-6b7b110a-dfbb-4b82-baab-d90536a44e30 tempest-VolumesTestJSON-1280965431 tempest-VolumesTestJSON-1280965431-project] Calling method '.version_select at 0x7f621fceb790>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:14.689225 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-6b7b110a-dfbb-4b82-baab-d90536a44e30 tempest-VolumesTestJSON-1280965431 tempest-VolumesTestJSON-1280965431-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/8c82a870-29f0-4a49-9328-51aae7e36e9b" status: 200 len: 351 microversion: 2.1 time: 0.094080 Sep 30 19:29:14.698385 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 23/30] 10.222.0.17 () {58 vars in 1245 bytes} [Fri Sep 30 19:29:14 2022] GET /compute/v2.1/os-volumes/8c82a870-29f0-4a49-9328-51aae7e36e9b => generated 351 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:29:14.703782 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-a4dfdad1-441b-4c06-82ae-7c026e6bfa5c tempest-VolumesSnapshotsTestJSON-404884988 tempest-VolumesSnapshotsTestJSON-404884988-project] Calling method '.version_select at 0x7f621fceb3a0>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:14.780517 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.wsgi [None req-a4dfdad1-441b-4c06-82ae-7c026e6bfa5c tempest-VolumesSnapshotsTestJSON-404884988 tempest-VolumesSnapshotsTestJSON-404884988-project] HTTP exception thrown: Volume a2a6423a-fe27-4d13-b81a-dd43ec5b73f5 could not be found. Sep 30 19:29:14.783030 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-a4dfdad1-441b-4c06-82ae-7c026e6bfa5c tempest-VolumesSnapshotsTestJSON-404884988 tempest-VolumesSnapshotsTestJSON-404884988-project] Request method failure captured: Sep 30 19:29:14.783030 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: request: GET /compute/v2.1/os-volumes/a2a6423a-fe27-4d13-b81a-dd43ec5b73f5 HTTP/1.1 Sep 30 19:29:14.783030 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 30 19:29:14.783030 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 30 19:29:14.783030 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Connection: close Sep 30 19:29:14.783030 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Length: 0 Sep 30 19:29:14.783030 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 30 19:29:14.783030 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Host: 10.222.0.17 Sep 30 19:29:14.783030 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 30 19:29:14.783030 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 30 19:29:14.783030 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjN0N7_eMv2unRymyVNynJUEe3QJvsWMSapXnAOYkhF3DkioozvSN4wRnC17VXjADtuoLLF1_p_EEzK74IqEfJ4_lsafGoD25ro33-79vSOi8Mc5NvFdGPc7IECx11Rn6jajlXoO2AQnJEPS8KKDa26hXWprHXfYViGpEo_4ngoVfZuDo Sep 30 19:29:14.783030 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 30 19:29:14.783030 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 30 19:29:14.783030 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 30 19:29:14.783030 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 30 19:29:14.783030 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 30 19:29:14.783030 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 30 19:29:14.783030 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Id: d9f37085e1ca47a88dc01edd217a9805 Sep 30 19:29:14.783030 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-404884988 Sep 30 19:29:14.783030 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 30 19:29:14.783030 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 30 19:29:14.784637 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d9f37085e1ca47a88dc01edd217a9805"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d9f37085e1ca47a88dc01edd217a9805"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d9f37085e1ca47a88dc01edd217a9805"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d9f37085e1ca47a88dc01edd217a9805"}]}] Sep 30 19:29:14.784637 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-VolumesSnapshotsTestJSON-404884988 Sep 30 19:29:14.784637 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Id: d9f37085e1ca47a88dc01edd217a9805 Sep 30 19:29:14.784637 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-404884988 Sep 30 19:29:14.784637 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User: tempest-VolumesSnapshotsTestJSON-404884988-project Sep 30 19:29:14.784637 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 30 19:29:14.784637 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 30 19:29:14.784637 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Id: 4427e3b5656a407dbbf7608985a64ab8 Sep 30 19:29:14.784637 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-VolumesSnapshotsTestJSON-404884988-project Sep 30 19:29:14.784637 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: method: Sep 30 19:29:14.784637 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: exception: Volume a2a6423a-fe27-4d13-b81a-dd43ec5b73f5 could not be found. Sep 30 19:29:14.784637 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: action_args: {'id': 'a2a6423a-fe27-4d13-b81a-dd43ec5b73f5'} Sep 30 19:29:14.784637 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:29:14.785426 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:29:14.785426 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 30 19:29:14.785426 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 30 19:29:14.785426 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 30 19:29:14.785426 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 30 19:29:14.785426 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 30 19:29:14.785426 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 30 19:29:14.785426 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 30 19:29:14.785426 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 30 19:29:14.785426 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 30 19:29:14.785426 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 30 19:29:14.785426 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 30 19:29:14.785426 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 30 19:29:14.785426 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 30 19:29:14.785426 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 30 19:29:14.785426 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a2a6423a-fe27-4d13-b81a-dd43ec5b73f5 could not be found. (HTTP 404) (Request-ID: req-db11cabe-c560-4868-9ea5-28e27f6f5723) Sep 30 19:29:14.785426 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:14.785426 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:29:14.785426 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:14.786651 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:29:14.786651 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 30 19:29:14.786651 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 30 19:29:14.786651 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 30 19:29:14.786651 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 30 19:29:14.786651 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 30 19:29:14.786651 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 30 19:29:14.786651 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 30 19:29:14.786651 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 30 19:29:14.786651 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 30 19:29:14.786651 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 30 19:29:14.786651 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 30 19:29:14.786651 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 30 19:29:14.786651 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 30 19:29:14.786651 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 30 19:29:14.786651 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 30 19:29:14.786651 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 30 19:29:14.786651 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 30 19:29:14.786651 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 30 19:29:14.787756 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 30 19:29:14.787756 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 30 19:29:14.787756 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 30 19:29:14.787756 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 30 19:29:14.787756 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a2a6423a-fe27-4d13-b81a-dd43ec5b73f5 could not be found. Sep 30 19:29:14.787756 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:14.787756 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:29:14.787756 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:14.787756 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:29:14.787756 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:29:14.787756 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:29:14.787756 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:29:14.787756 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:29:14.787756 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 30 19:29:14.787756 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 30 19:29:14.787756 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:29:14.787756 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:29:14.787756 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 30 19:29:14.787756 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 30 19:29:14.789094 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a2a6423a-fe27-4d13-b81a-dd43ec5b73f5 could not be found. Sep 30 19:29:14.789094 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:14.789094 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:29:14.789094 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:14.789094 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:29:14.789094 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:29:14.789094 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:29:14.789094 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:29:14.789094 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:29:14.789094 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a2a6423a-fe27-4d13-b81a-dd43ec5b73f5 could not be found. Sep 30 19:29:14.789094 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:14.790775 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-a4dfdad1-441b-4c06-82ae-7c026e6bfa5c tempest-VolumesSnapshotsTestJSON-404884988 tempest-VolumesSnapshotsTestJSON-404884988-project] Returning 404 to user: Volume a2a6423a-fe27-4d13-b81a-dd43ec5b73f5 could not be found. {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:29:14.791823 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-a4dfdad1-441b-4c06-82ae-7c026e6bfa5c tempest-VolumesSnapshotsTestJSON-404884988 tempest-VolumesSnapshotsTestJSON-404884988-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/a2a6423a-fe27-4d13-b81a-dd43ec5b73f5" status: 404 len: 109 microversion: 2.1 time: 0.092170 Sep 30 19:29:14.792892 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 24/31] 10.222.0.17 () {58 vars in 1245 bytes} [Fri Sep 30 19:29:14 2022] GET /compute/v2.1/os-volumes/a2a6423a-fe27-4d13-b81a-dd43ec5b73f5 => generated 109 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 30 19:29:14.805578 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-be9d94c5-d39a-4832-a1f2-e68a29a3ed08 tempest-VolumesTestJSON-1280965431 tempest-VolumesTestJSON-1280965431-project] Calling method '.version_select at 0x7f621fceba60>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:14.919935 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-be9d94c5-d39a-4832-a1f2-e68a29a3ed08 tempest-VolumesTestJSON-1280965431 tempest-VolumesTestJSON-1280965431-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.125761 Sep 30 19:29:14.920759 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 25/32] 10.222.0.17 () {58 vars in 1134 bytes} [Fri Sep 30 19:29:14 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:14.926039 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-2e86eb6c-c3f0-400a-a37e-71035570812f tempest-VolumesSnapshotsTestJSON-404884988 tempest-VolumesSnapshotsTestJSON-404884988-project] Calling method '.version_select at 0x7f621fd02040>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:14.977372 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.wsgi [None req-2e86eb6c-c3f0-400a-a37e-71035570812f tempest-VolumesSnapshotsTestJSON-404884988 tempest-VolumesSnapshotsTestJSON-404884988-project] HTTP exception thrown: Volume a2a6423a-fe27-4d13-b81a-dd43ec5b73f5 could not be found. Sep 30 19:29:14.979332 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-2e86eb6c-c3f0-400a-a37e-71035570812f tempest-VolumesSnapshotsTestJSON-404884988 tempest-VolumesSnapshotsTestJSON-404884988-project] Request method failure captured: Sep 30 19:29:14.979332 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: request: DELETE /compute/v2.1/os-volumes/a2a6423a-fe27-4d13-b81a-dd43ec5b73f5 HTTP/1.1 Sep 30 19:29:14.979332 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 30 19:29:14.979332 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 30 19:29:14.979332 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Connection: close Sep 30 19:29:14.979332 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Length: 0 Sep 30 19:29:14.979332 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 30 19:29:14.979332 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Host: 10.222.0.17 Sep 30 19:29:14.979332 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 30 19:29:14.979332 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 30 19:29:14.979332 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjN0N7_eMv2unRymyVNynJUEe3QJvsWMSapXnAOYkhF3DkioozvSN4wRnC17VXjADtuoLLF1_p_EEzK74IqEfJ4_lsafGoD25ro33-79vSOi8Mc5NvFdGPc7IECx11Rn6jajlXoO2AQnJEPS8KKDa26hXWprHXfYViGpEo_4ngoVfZuDo Sep 30 19:29:14.979332 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 30 19:29:14.979332 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 30 19:29:14.979332 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 30 19:29:14.979332 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 30 19:29:14.979332 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 30 19:29:14.979332 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 30 19:29:14.979332 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Id: d9f37085e1ca47a88dc01edd217a9805 Sep 30 19:29:14.979332 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-404884988 Sep 30 19:29:14.979332 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 30 19:29:14.979332 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 30 19:29:14.980625 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d9f37085e1ca47a88dc01edd217a9805"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d9f37085e1ca47a88dc01edd217a9805"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d9f37085e1ca47a88dc01edd217a9805"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d9f37085e1ca47a88dc01edd217a9805"}]}] Sep 30 19:29:14.980625 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-VolumesSnapshotsTestJSON-404884988 Sep 30 19:29:14.980625 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Id: d9f37085e1ca47a88dc01edd217a9805 Sep 30 19:29:14.980625 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-404884988 Sep 30 19:29:14.980625 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User: tempest-VolumesSnapshotsTestJSON-404884988-project Sep 30 19:29:14.980625 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 30 19:29:14.980625 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 30 19:29:14.980625 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Id: 4427e3b5656a407dbbf7608985a64ab8 Sep 30 19:29:14.980625 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-VolumesSnapshotsTestJSON-404884988-project Sep 30 19:29:14.980625 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: method: Sep 30 19:29:14.980625 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: exception: Volume a2a6423a-fe27-4d13-b81a-dd43ec5b73f5 could not be found. Sep 30 19:29:14.980625 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: action_args: {'id': 'a2a6423a-fe27-4d13-b81a-dd43ec5b73f5'} Sep 30 19:29:14.980625 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:29:14.981410 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:29:14.981410 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 30 19:29:14.981410 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 30 19:29:14.981410 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 30 19:29:14.981410 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 30 19:29:14.981410 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 30 19:29:14.981410 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 30 19:29:14.981410 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 30 19:29:14.981410 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 30 19:29:14.981410 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 30 19:29:14.981410 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 30 19:29:14.981410 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 30 19:29:14.981410 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 30 19:29:14.981410 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 30 19:29:14.981410 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 30 19:29:14.981410 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a2a6423a-fe27-4d13-b81a-dd43ec5b73f5 could not be found. (HTTP 404) (Request-ID: req-705e656c-822b-4758-a0b1-ebf1c80bd1c4) Sep 30 19:29:14.981410 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:14.981410 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:29:14.981410 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:14.982743 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:29:14.982743 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 30 19:29:14.982743 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 30 19:29:14.982743 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 30 19:29:14.982743 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 30 19:29:14.982743 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 30 19:29:14.982743 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 30 19:29:14.982743 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 30 19:29:14.982743 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 30 19:29:14.982743 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 30 19:29:14.982743 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 30 19:29:14.982743 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 30 19:29:14.982743 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 30 19:29:14.982743 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 30 19:29:14.982743 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 30 19:29:14.982743 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 30 19:29:14.982743 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 30 19:29:14.982743 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 30 19:29:14.982743 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 30 19:29:14.983641 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 30 19:29:14.983641 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 30 19:29:14.983641 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 30 19:29:14.983641 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 30 19:29:14.983641 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a2a6423a-fe27-4d13-b81a-dd43ec5b73f5 could not be found. Sep 30 19:29:14.983641 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:14.983641 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:29:14.983641 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:14.983641 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:29:14.983641 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:29:14.983641 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:29:14.983641 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:29:14.983641 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:29:14.983641 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 30 19:29:14.983641 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 30 19:29:14.983641 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:29:14.983641 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:29:14.983641 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 30 19:29:14.983641 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 30 19:29:14.985720 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a2a6423a-fe27-4d13-b81a-dd43ec5b73f5 could not be found. Sep 30 19:29:14.985720 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:14.985720 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:29:14.985720 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:14.985720 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:29:14.985720 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:29:14.985720 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:29:14.985720 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:29:14.985720 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:29:14.985720 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a2a6423a-fe27-4d13-b81a-dd43ec5b73f5 could not be found. Sep 30 19:29:14.985720 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:14.985720 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-2e86eb6c-c3f0-400a-a37e-71035570812f tempest-VolumesSnapshotsTestJSON-404884988 tempest-VolumesSnapshotsTestJSON-404884988-project] Returning 404 to user: Volume a2a6423a-fe27-4d13-b81a-dd43ec5b73f5 could not be found. {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:29:14.985720 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-2e86eb6c-c3f0-400a-a37e-71035570812f tempest-VolumesSnapshotsTestJSON-404884988 tempest-VolumesSnapshotsTestJSON-404884988-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/a2a6423a-fe27-4d13-b81a-dd43ec5b73f5" status: 404 len: 109 microversion: 2.1 time: 0.059068 Sep 30 19:29:14.985720 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 26/33] 10.222.0.17 () {58 vars in 1248 bytes} [Fri Sep 30 19:29:14 2022] DELETE /compute/v2.1/os-volumes/a2a6423a-fe27-4d13-b81a-dd43ec5b73f5 => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 30 19:29:14.987344 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e5e5c05f-f8e1-452c-a555-1ed984711266 tempest-VolumesTestJSON-1280965431 tempest-VolumesTestJSON-1280965431-project] Calling method '.version_select at 0x7f621fce0af0>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:15.170111 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-e5e5c05f-f8e1-452c-a555-1ed984711266 tempest-VolumesTestJSON-1280965431 tempest-VolumesTestJSON-1280965431-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.187593 Sep 30 19:29:15.179526 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 27/34] 10.222.0.17 () {58 vars in 1149 bytes} [Fri Sep 30 19:29:14 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:29:15.179526 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-47b3fe7c-c2e9-4ac3-952c-74d29238ddd2 tempest-VolumesSnapshotsTestJSON-404884988 tempest-VolumesSnapshotsTestJSON-404884988-project] Calling method '.version_select at 0x7f621fd02700>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:15.220907 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.wsgi [None req-47b3fe7c-c2e9-4ac3-952c-74d29238ddd2 tempest-VolumesSnapshotsTestJSON-404884988 tempest-VolumesSnapshotsTestJSON-404884988-project] HTTP exception thrown: Volume a2a6423a-fe27-4d13-b81a-dd43ec5b73f5 could not be found. Sep 30 19:29:15.226069 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-47b3fe7c-c2e9-4ac3-952c-74d29238ddd2 tempest-VolumesSnapshotsTestJSON-404884988 tempest-VolumesSnapshotsTestJSON-404884988-project] Request method failure captured: Sep 30 19:29:15.226069 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: request: GET /compute/v2.1/os-volumes/a2a6423a-fe27-4d13-b81a-dd43ec5b73f5 HTTP/1.1 Sep 30 19:29:15.226069 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 30 19:29:15.226069 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 30 19:29:15.226069 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Connection: close Sep 30 19:29:15.226069 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Length: 0 Sep 30 19:29:15.226069 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 30 19:29:15.226069 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Host: 10.222.0.17 Sep 30 19:29:15.226069 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 30 19:29:15.226069 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 30 19:29:15.226069 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjN0N7_eMv2unRymyVNynJUEe3QJvsWMSapXnAOYkhF3DkioozvSN4wRnC17VXjADtuoLLF1_p_EEzK74IqEfJ4_lsafGoD25ro33-79vSOi8Mc5NvFdGPc7IECx11Rn6jajlXoO2AQnJEPS8KKDa26hXWprHXfYViGpEo_4ngoVfZuDo Sep 30 19:29:15.226069 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 30 19:29:15.226069 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 30 19:29:15.226069 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 30 19:29:15.226069 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 30 19:29:15.226069 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 30 19:29:15.226069 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 30 19:29:15.226069 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Id: d9f37085e1ca47a88dc01edd217a9805 Sep 30 19:29:15.226069 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-404884988 Sep 30 19:29:15.226069 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 30 19:29:15.226069 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 30 19:29:15.227397 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d9f37085e1ca47a88dc01edd217a9805"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d9f37085e1ca47a88dc01edd217a9805"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d9f37085e1ca47a88dc01edd217a9805"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d9f37085e1ca47a88dc01edd217a9805"}]}] Sep 30 19:29:15.227397 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-VolumesSnapshotsTestJSON-404884988 Sep 30 19:29:15.227397 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Id: d9f37085e1ca47a88dc01edd217a9805 Sep 30 19:29:15.227397 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-404884988 Sep 30 19:29:15.227397 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User: tempest-VolumesSnapshotsTestJSON-404884988-project Sep 30 19:29:15.227397 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 30 19:29:15.227397 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 30 19:29:15.227397 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Id: 4427e3b5656a407dbbf7608985a64ab8 Sep 30 19:29:15.227397 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-VolumesSnapshotsTestJSON-404884988-project Sep 30 19:29:15.227397 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: method: Sep 30 19:29:15.227397 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: exception: Volume a2a6423a-fe27-4d13-b81a-dd43ec5b73f5 could not be found. Sep 30 19:29:15.227397 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: action_args: {'id': 'a2a6423a-fe27-4d13-b81a-dd43ec5b73f5'} Sep 30 19:29:15.227397 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:29:15.228056 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:29:15.228056 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 30 19:29:15.228056 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 30 19:29:15.228056 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 30 19:29:15.228056 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 30 19:29:15.228056 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 30 19:29:15.228056 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 30 19:29:15.228056 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 30 19:29:15.228056 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 30 19:29:15.228056 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 30 19:29:15.228056 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 30 19:29:15.228056 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 30 19:29:15.228056 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 30 19:29:15.228056 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 30 19:29:15.228056 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 30 19:29:15.228056 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a2a6423a-fe27-4d13-b81a-dd43ec5b73f5 could not be found. (HTTP 404) (Request-ID: req-9ce27df5-a2c3-4233-a50c-f3912b09b424) Sep 30 19:29:15.228056 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:15.228056 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:29:15.228056 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:15.229701 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:29:15.229701 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 30 19:29:15.229701 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 30 19:29:15.229701 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 30 19:29:15.229701 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 30 19:29:15.229701 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 30 19:29:15.229701 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 30 19:29:15.229701 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 30 19:29:15.229701 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 30 19:29:15.229701 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 30 19:29:15.229701 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 30 19:29:15.229701 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 30 19:29:15.229701 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 30 19:29:15.229701 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 30 19:29:15.229701 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 30 19:29:15.229701 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 30 19:29:15.229701 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 30 19:29:15.229701 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 30 19:29:15.229701 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 30 19:29:15.230602 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 30 19:29:15.230602 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 30 19:29:15.230602 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 30 19:29:15.230602 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 30 19:29:15.230602 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a2a6423a-fe27-4d13-b81a-dd43ec5b73f5 could not be found. Sep 30 19:29:15.230602 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:15.230602 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:29:15.230602 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:15.230602 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:29:15.230602 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:29:15.230602 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:29:15.230602 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:29:15.230602 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:29:15.230602 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 30 19:29:15.230602 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 30 19:29:15.230602 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:29:15.230602 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:29:15.230602 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 30 19:29:15.230602 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 30 19:29:15.232187 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a2a6423a-fe27-4d13-b81a-dd43ec5b73f5 could not be found. Sep 30 19:29:15.232187 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:15.232187 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:29:15.232187 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:15.232187 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:29:15.232187 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:29:15.232187 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:29:15.232187 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:29:15.232187 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:29:15.232187 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a2a6423a-fe27-4d13-b81a-dd43ec5b73f5 could not be found. Sep 30 19:29:15.232187 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:29:15.232187 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-47b3fe7c-c2e9-4ac3-952c-74d29238ddd2 tempest-VolumesSnapshotsTestJSON-404884988 tempest-VolumesSnapshotsTestJSON-404884988-project] Returning 404 to user: Volume a2a6423a-fe27-4d13-b81a-dd43ec5b73f5 could not be found. {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:29:15.232187 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-47b3fe7c-c2e9-4ac3-952c-74d29238ddd2 tempest-VolumesSnapshotsTestJSON-404884988 tempest-VolumesSnapshotsTestJSON-404884988-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/a2a6423a-fe27-4d13-b81a-dd43ec5b73f5" status: 404 len: 109 microversion: 2.1 time: 0.055777 Sep 30 19:29:15.232187 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 28/35] 10.222.0.17 () {58 vars in 1245 bytes} [Fri Sep 30 19:29:15 2022] GET /compute/v2.1/os-volumes/a2a6423a-fe27-4d13-b81a-dd43ec5b73f5 => generated 109 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 30 19:29:15.235388 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-7e17ecfb-d0a9-4493-b33b-42e7ea8d920c tempest-VolumesTestJSON-1280965431 tempest-VolumesTestJSON-1280965431-project] Calling method '.version_select at 0x7f621fce08b0>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:15.427087 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-7e17ecfb-d0a9-4493-b33b-42e7ea8d920c tempest-VolumesTestJSON-1280965431 tempest-VolumesTestJSON-1280965431-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.197219 Sep 30 19:29:15.428159 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 29/36] 10.222.0.17 () {58 vars in 1134 bytes} [Fri Sep 30 19:29:15 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:15.443261 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-d66df8bb-cb77-40e8-b82b-7a5084b35b60 tempest-VolumesTestJSON-1280965431 tempest-VolumesTestJSON-1280965431-project] Calling method '.version_select at 0x7f621fd02160>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:15.586286 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.virt.hardware [None req-dabd524a-9fc8-4155-bb2b-ec940b5b90b3 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Flavor limits 0:0:0 {{(pid=120649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 30 19:29:15.586750 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.virt.hardware [None req-dabd524a-9fc8-4155-bb2b-ec940b5b90b3 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Image limits 0:0:0 {{(pid=120649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 30 19:29:15.587177 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.virt.hardware [None req-dabd524a-9fc8-4155-bb2b-ec940b5b90b3 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Flavor pref 0:0:0 {{(pid=120649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 30 19:29:15.587644 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.virt.hardware [None req-dabd524a-9fc8-4155-bb2b-ec940b5b90b3 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Image pref 0:0:0 {{(pid=120649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 30 19:29:15.588062 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.virt.hardware [None req-dabd524a-9fc8-4155-bb2b-ec940b5b90b3 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 30 19:29:15.624299 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-dabd524a-9fc8-4155-bb2b-ec940b5b90b3 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:15.625320 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-dabd524a-9fc8-4155-bb2b-ec940b5b90b3 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:15.626546 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-dabd524a-9fc8-4155-bb2b-ec940b5b90b3 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:15.628203 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-dabd524a-9fc8-4155-bb2b-ec940b5b90b3 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:15.631748 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-dabd524a-9fc8-4155-bb2b-ec940b5b90b3 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:15.632194 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-dabd524a-9fc8-4155-bb2b-ec940b5b90b3 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:15.680833 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-d66df8bb-cb77-40e8-b82b-7a5084b35b60 tempest-VolumesTestJSON-1280965431 tempest-VolumesTestJSON-1280965431-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.243147 Sep 30 19:29:15.682030 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 30/37] 10.222.0.17 () {58 vars in 1167 bytes} [Fri Sep 30 19:29:15 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 30 19:29:15.736212 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.quota [None req-dabd524a-9fc8-4155-bb2b-ec940b5b90b3 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Getting quotas for project d9758637e30e4089b394ed6ea5c2cf3f. Resources: {'instances', 'ram', 'cores'} {{(pid=120649) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 30 19:29:15.759961 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.quota [None req-dabd524a-9fc8-4155-bb2b-ec940b5b90b3 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Getting quotas for user f1bb718f9153493ca6dda343d461c5ab and project d9758637e30e4089b394ed6ea5c2cf3f. Resources: {'instances', 'ram', 'cores'} {{(pid=120649) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 30 19:29:15.791217 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-dabd524a-9fc8-4155-bb2b-ec940b5b90b3 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Going to run 1 instances... {{(pid=120649) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 30 19:29:15.797649 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-dabd524a-9fc8-4155-bb2b-ec940b5b90b3 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] [instance: 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7714d055-7d2c-4f56-9b14-45324361e286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 30 19:29:16.031216 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-dabd524a-9fc8-4155-bb2b-ec940b5b90b3 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.628165 Sep 30 19:29:16.036079 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 8/38] 10.222.0.17 () {60 vars in 1147 bytes} [Fri Sep 30 19:29:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 4634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 30 19:29:16.062804 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-57c0a4ae-1a82-4ac1-b654-f82d27eae35a tempest-VolumesTestJSON-1280965431 tempest-VolumesTestJSON-1280965431-project] Calling method '.version_select at 0x7f621f472550>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:16.351204 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-57c0a4ae-1a82-4ac1-b654-f82d27eae35a tempest-VolumesTestJSON-1280965431 tempest-VolumesTestJSON-1280965431-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.313471 Sep 30 19:29:16.362526 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 9/39] 10.222.0.17 () {58 vars in 1170 bytes} [Fri Sep 30 19:29:16 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:29:16.368034 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-e1f695a5-9b5b-4338-971d-fec54fe840af tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:16.368713 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-e1f695a5-9b5b-4338-971d-fec54fe840af tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] [instance: 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:16.646112 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-84f528d1-78e5-418f-84d4-62f3989a8285 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Action: 'create', calling method: .version_select at 0x7f621fceb820>, body: {"keypair": {"name": "tempest-keypair-254540382", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZY0HwIRvLwETynh9hau0XF4DZ+TiwWzzzGABIwRTDbKzWCb4f/ukaoXqPQHjSDEYfRpk4afYwD78qnP+p3L3IxEMQxbcuN8/IS3mUT2pz+tqyBEvBRrgd++386/nFkgA=="}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:29:16.787558 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-84f528d1-78e5-418f-84d4-62f3989a8285 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Getting quotas for project ac5815ead619491680fb44af178e9cc0. Resources: {'key_pairs'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 30 19:29:16.806183 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-84f528d1-78e5-418f-84d4-62f3989a8285 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Getting quotas for user a397314cdd52409c920071ae009516af and project ac5815ead619491680fb44af178e9cc0. Resources: {'key_pairs'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 30 19:29:16.892469 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-84f528d1-78e5-418f-84d4-62f3989a8285 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.208966 Sep 30 19:29:16.894237 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 31/40] 10.222.0.17 () {60 vars in 1159 bytes} [Fri Sep 30 19:29:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:29:16.900488 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-e1f695a5-9b5b-4338-971d-fec54fe840af tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bb718f9153493ca6dda343d461c5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9758637e30e4089b394ed6ea5c2cf3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:16.917194 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-551192d3-6f21-4395-92e6-9294b436cd7e tempest-VolumesTestJSON-1280965431 tempest-VolumesTestJSON-1280965431-project] Calling method '.version_select at 0x7f621fcccd30>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:16.939353 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-e1f695a5-9b5b-4338-971d-fec54fe840af tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] 10.222.0.17 "GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf" status: 200 len: 1215 microversion: 2.1 time: 0.572946 Sep 30 19:29:16.941422 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 10/41] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:16 2022] GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf => generated 1215 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:17.198018 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-551192d3-6f21-4395-92e6-9294b436cd7e tempest-VolumesTestJSON-1280965431 tempest-VolumesTestJSON-1280965431-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.302252 Sep 30 19:29:17.199099 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 32/42] 10.222.0.17 () {58 vars in 1155 bytes} [Fri Sep 30 19:29:16 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:17.217292 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-c4625133-90bd-4675-86cf-e6f4f3a470b9 tempest-VolumesTestJSON-1280965431 tempest-VolumesTestJSON-1280965431-project] Calling method '.version_select at 0x7f621fc75430>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:17.524486 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-c4625133-90bd-4675-86cf-e6f4f3a470b9 tempest-VolumesTestJSON-1280965431 tempest-VolumesTestJSON-1280965431-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.311137 Sep 30 19:29:17.526373 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 33/43] 10.222.0.17 () {58 vars in 1188 bytes} [Fri Sep 30 19:29:17 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:29:17.897599 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-11be0ab4-ed73-4485-b0ea-3725bca0669a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-383270439", "imageRef": "7714d055-7d2c-4f56-9b14-45324361e286", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:29:17.921669 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-33729977-930f-4bad-ab4a-fa6154902262 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Action: 'create', calling method: .version_select at 0x7f621fc75e50>, body: {"keypair": {"name": "tempest-keypair-1319065844", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNFRl1rBE3urWckJJvSPeETskVvEpHQBFzD4Kptmr1bG79h335IGeOLy8TKuJQnLbIVmo8UE1mba0WwXi/HZD2/dFJEp8KAOr8uUIC6XHPrw82GWv+fajkbf4kKd22W4UQ=="}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:29:17.995805 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-33729977-930f-4bad-ab4a-fa6154902262 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Getting quotas for project 612fb8a339e4478ba78bc5ef3b343b82. Resources: {'key_pairs'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 30 19:29:18.015577 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-33729977-930f-4bad-ab4a-fa6154902262 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Getting quotas for user ccbdadc310fc4bf8a6679bcb39b34ff1 and project 612fb8a339e4478ba78bc5ef3b343b82. Resources: {'key_pairs'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 30 19:29:18.080101 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.network.neutron [None req-11be0ab4-ed73-4485-b0ea-3725bca0669a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] validate_networks() for [('bf663f3e-a66c-4db9-b314-d432454a6e93', None, None, None, None, None)] {{(pid=120649) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 30 19:29:18.123946 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-33729977-930f-4bad-ab4a-fa6154902262 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.596289 Sep 30 19:29:18.144113 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 34/44] 10.222.0.17 () {60 vars in 1159 bytes} [Fri Sep 30 19:29:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:29:18.153625 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-49e354c3-29fe-48dd-9031-a99345cf3de9 tempest-VolumesTestJSON-1280965431 tempest-VolumesTestJSON-1280965431-project] Calling method '.version_select at 0x7f621fc708b0>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:18.413697 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-49e354c3-29fe-48dd-9031-a99345cf3de9 tempest-VolumesTestJSON-1280965431 tempest-VolumesTestJSON-1280965431-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.272339 Sep 30 19:29:18.415348 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 35/45] 10.222.0.17 () {58 vars in 1155 bytes} [Fri Sep 30 19:29:18 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:19.101968 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-a29b87ed-d8d5-433c-83b9-3dbc3ef52205 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Action: 'create', calling method: .version_select at 0x7f621fc74e50>, body: {"keypair": {"name": "tempest-keypair-1346387074", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPXL1xcR0dFikVNNDACDFGXG4PMOz/ZcxgXrylJTLiu0gYDCd+D88kOjJspuMHTZwTmqoEWBigXRn04iVX4FCJdb8xIOVKAmjZeaxcuN/mT8hjQH91YQlQL6WwyHY3wRwg=="}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:29:19.155952 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-a29b87ed-d8d5-433c-83b9-3dbc3ef52205 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Getting quotas for project 395bb9b09f7948bbad5817c88aa4accc. Resources: {'key_pairs'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 30 19:29:19.177171 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-a29b87ed-d8d5-433c-83b9-3dbc3ef52205 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Getting quotas for user f7aa40f3966d4c97ab6a1a764722969d and project 395bb9b09f7948bbad5817c88aa4accc. Resources: {'key_pairs'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 30 19:29:19.256925 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-a29b87ed-d8d5-433c-83b9-3dbc3ef52205 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.838086 Sep 30 19:29:19.258498 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 36/46] 10.222.0.17 () {62 vars in 1200 bytes} [Fri Sep 30 19:29:18 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 842 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 30 19:29:19.278805 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-23cdfb19-f20e-4b63-84f1-07c90333867c tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:19.280427 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-23cdfb19-f20e-4b63-84f1-07c90333867c tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] [instance: 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:19.518550 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.virt.hardware [None req-11be0ab4-ed73-4485-b0ea-3725bca0669a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Flavor limits 0:0:0 {{(pid=120649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 30 19:29:19.519879 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.virt.hardware [None req-11be0ab4-ed73-4485-b0ea-3725bca0669a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Image limits 0:0:0 {{(pid=120649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 30 19:29:19.520617 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.virt.hardware [None req-11be0ab4-ed73-4485-b0ea-3725bca0669a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Flavor pref 0:0:0 {{(pid=120649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 30 19:29:19.522532 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.virt.hardware [None req-11be0ab4-ed73-4485-b0ea-3725bca0669a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Image pref 0:0:0 {{(pid=120649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 30 19:29:19.527596 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-23cdfb19-f20e-4b63-84f1-07c90333867c tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bb718f9153493ca6dda343d461c5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9758637e30e4089b394ed6ea5c2cf3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:19.535834 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.virt.hardware [None req-11be0ab4-ed73-4485-b0ea-3725bca0669a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 30 19:29:19.604035 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-11be0ab4-ed73-4485-b0ea-3725bca0669a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:19.606658 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-11be0ab4-ed73-4485-b0ea-3725bca0669a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:19.617066 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-11be0ab4-ed73-4485-b0ea-3725bca0669a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:19.617969 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-11be0ab4-ed73-4485-b0ea-3725bca0669a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:19.621945 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-11be0ab4-ed73-4485-b0ea-3725bca0669a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:19.622405 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-11be0ab4-ed73-4485-b0ea-3725bca0669a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:19.632245 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-23cdfb19-f20e-4b63-84f1-07c90333867c tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] 10.222.0.17 "GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf" status: 200 len: 1215 microversion: 2.1 time: 0.370291 Sep 30 19:29:19.645036 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 37/47] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:19 2022] GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf => generated 1215 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:19.694486 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.quota [None req-11be0ab4-ed73-4485-b0ea-3725bca0669a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Getting quotas for project de44d50bb79d48189cd74cad8079e01f. Resources: {'instances', 'ram', 'cores'} {{(pid=120649) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 30 19:29:19.699563 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.quota [None req-11be0ab4-ed73-4485-b0ea-3725bca0669a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Getting quotas for user 624738daa9db4aff885d71ea2d65fb26 and project de44d50bb79d48189cd74cad8079e01f. Resources: {'instances', 'ram', 'cores'} {{(pid=120649) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 30 19:29:19.731064 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-11be0ab4-ed73-4485-b0ea-3725bca0669a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Going to run 1 instances... {{(pid=120649) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 30 19:29:19.733288 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-11be0ab4-ed73-4485-b0ea-3725bca0669a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 5fd6c296-8008-4f27-82c0-36839a4eec3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7714d055-7d2c-4f56-9b14-45324361e286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 30 19:29:19.906237 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-11be0ab4-ed73-4485-b0ea-3725bca0669a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.894404 Sep 30 19:29:19.912551 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 11/48] 10.222.0.17 () {60 vars in 1147 bytes} [Fri Sep 30 19:29:17 2022] POST /compute/v2.1/servers => generated 383 bytes in 2905 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 30 19:29:19.926334 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-1b43c497-fe79-4f44-b3d9-e93053be5a37 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:19.927167 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-1b43c497-fe79-4f44-b3d9-e93053be5a37 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 5fd6c296-8008-4f27-82c0-36839a4eec3f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:20.392057 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-1b43c497-fe79-4f44-b3d9-e93053be5a37 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:20.416140 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-1b43c497-fe79-4f44-b3d9-e93053be5a37 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f" status: 200 len: 1221 microversion: 2.1 time: 0.494919 Sep 30 19:29:20.435088 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 38/49] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:19 2022] GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f => generated 1221 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:20.660831 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-2779388b-525b-4a6b-882c-2e6ed4f55bd2 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:20.661521 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-2779388b-525b-4a6b-882c-2e6ed4f55bd2 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] [instance: 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:20.672160 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2779388b-525b-4a6b-882c-2e6ed4f55bd2 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:20.672873 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2779388b-525b-4a6b-882c-2e6ed4f55bd2 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:20.677148 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2779388b-525b-4a6b-882c-2e6ed4f55bd2 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:20.679531 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2779388b-525b-4a6b-882c-2e6ed4f55bd2 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:20.681635 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2779388b-525b-4a6b-882c-2e6ed4f55bd2 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:20.683580 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2779388b-525b-4a6b-882c-2e6ed4f55bd2 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:20.810668 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-5931a0b5-c92d-4b9f-9975-bbf074fbf108 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1057613240", "imageRef": "7714d055-7d2c-4f56-9b14-45324361e286", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:29:21.051285 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.network.neutron [None req-5931a0b5-c92d-4b9f-9975-bbf074fbf108 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] validate_networks() for [('bf663f3e-a66c-4db9-b314-d432454a6e93', None, None, None, None, None)] {{(pid=120648) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 30 19:29:21.265591 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-2779388b-525b-4a6b-882c-2e6ed4f55bd2 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bb718f9153493ca6dda343d461c5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9758637e30e4089b394ed6ea5c2cf3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:21.291903 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-2779388b-525b-4a6b-882c-2e6ed4f55bd2 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] 10.222.0.17 "GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf" status: 200 len: 1267 microversion: 2.1 time: 0.636056 Sep 30 19:29:21.292710 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 12/50] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:20 2022] GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf => generated 1267 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:22.320906 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-49b349c6-6e3d-4c25-b850-f1dc6123963a tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:22.321544 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-49b349c6-6e3d-4c25-b850-f1dc6123963a tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] [instance: 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:22.352571 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-49b349c6-6e3d-4c25-b850-f1dc6123963a tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:22.355278 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-49b349c6-6e3d-4c25-b850-f1dc6123963a tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:22.356625 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-49b349c6-6e3d-4c25-b850-f1dc6123963a tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:22.357517 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-49b349c6-6e3d-4c25-b850-f1dc6123963a tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:22.359356 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-49b349c6-6e3d-4c25-b850-f1dc6123963a tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:22.359960 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-49b349c6-6e3d-4c25-b850-f1dc6123963a tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:22.722676 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-49b349c6-6e3d-4c25-b850-f1dc6123963a tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bb718f9153493ca6dda343d461c5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9758637e30e4089b394ed6ea5c2cf3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:22.734254 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-49b349c6-6e3d-4c25-b850-f1dc6123963a tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] 10.222.0.17 "GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf" status: 200 len: 1273 microversion: 2.1 time: 0.417720 Sep 30 19:29:22.738055 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 13/51] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:22 2022] GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf => generated 1273 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:23.767080 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-cd81cd5d-d072-41f5-b15d-7b7fb68956dc tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:23.768552 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-cd81cd5d-d072-41f5-b15d-7b7fb68956dc tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] [instance: 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:23.780709 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-cd81cd5d-d072-41f5-b15d-7b7fb68956dc tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:23.782298 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-cd81cd5d-d072-41f5-b15d-7b7fb68956dc tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:23.786111 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-cd81cd5d-d072-41f5-b15d-7b7fb68956dc tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:23.790080 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-cd81cd5d-d072-41f5-b15d-7b7fb68956dc tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:23.791531 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-cd81cd5d-d072-41f5-b15d-7b7fb68956dc tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:23.793600 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-cd81cd5d-d072-41f5-b15d-7b7fb68956dc tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:24.428275 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-cd81cd5d-d072-41f5-b15d-7b7fb68956dc tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bb718f9153493ca6dda343d461c5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9758637e30e4089b394ed6ea5c2cf3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:24.451640 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-cd81cd5d-d072-41f5-b15d-7b7fb68956dc tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] 10.222.0.17 "GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf" status: 200 len: 1273 microversion: 2.1 time: 0.686823 Sep 30 19:29:24.455978 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 14/52] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:23 2022] GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf => generated 1273 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:24.465016 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-4f28b93f-cfb9-4fde-af4d-521a1a5fd21c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-566901965", "imageRef": "7714d055-7d2c-4f56-9b14-45324361e286", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0c1e5405-3945-456e-8e1d-e94d5c819889"}], "security_groups": [{"name": "tempest-securitygroup--701612468"}], "key_name": "tempest-keypair-1319065844", "user_data": "}} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:29:24.878054 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.network.neutron [None req-4f28b93f-cfb9-4fde-af4d-521a1a5fd21c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] validate_networks() for [('0c1e5405-3945-456e-8e1d-e94d5c819889', None, None, None, None, None)] {{(pid=120649) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 30 19:29:26.344932 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-5931a0b5-c92d-4b9f-9975-bbf074fbf108 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Flavor limits 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 30 19:29:26.345473 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-5931a0b5-c92d-4b9f-9975-bbf074fbf108 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Image limits 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 30 19:29:26.345969 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-5931a0b5-c92d-4b9f-9975-bbf074fbf108 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Flavor pref 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 30 19:29:26.346387 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-5931a0b5-c92d-4b9f-9975-bbf074fbf108 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Image pref 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 30 19:29:26.346809 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-5931a0b5-c92d-4b9f-9975-bbf074fbf108 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 30 19:29:26.369859 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5931a0b5-c92d-4b9f-9975-bbf074fbf108 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:26.370360 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5931a0b5-c92d-4b9f-9975-bbf074fbf108 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:26.370950 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5931a0b5-c92d-4b9f-9975-bbf074fbf108 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:26.371783 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5931a0b5-c92d-4b9f-9975-bbf074fbf108 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:26.380402 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5931a0b5-c92d-4b9f-9975-bbf074fbf108 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:26.390152 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5931a0b5-c92d-4b9f-9975-bbf074fbf108 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:26.448804 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-5931a0b5-c92d-4b9f-9975-bbf074fbf108 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Getting quotas for project de44d50bb79d48189cd74cad8079e01f. Resources: {'instances', 'ram', 'cores'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 30 19:29:26.478297 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-5931a0b5-c92d-4b9f-9975-bbf074fbf108 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Getting quotas for user 624738daa9db4aff885d71ea2d65fb26 and project de44d50bb79d48189cd74cad8079e01f. Resources: {'instances', 'ram', 'cores'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 30 19:29:26.553963 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-5931a0b5-c92d-4b9f-9975-bbf074fbf108 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Going to run 1 instances... {{(pid=120648) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 30 19:29:26.570214 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-5931a0b5-c92d-4b9f-9975-bbf074fbf108 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7714d055-7d2c-4f56-9b14-45324361e286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 30 19:29:26.805132 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-5931a0b5-c92d-4b9f-9975-bbf074fbf108 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.997708 Sep 30 19:29:26.809203 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 39/53] 10.222.0.17 () {60 vars in 1147 bytes} [Fri Sep 30 19:29:20 2022] POST /compute/v2.1/servers => generated 383 bytes in 6003 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 30 19:29:26.833702 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-4a84ca2c-c8dd-4b4f-87a8-bfe969559da3 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:26.840095 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.virt.hardware [None req-4f28b93f-cfb9-4fde-af4d-521a1a5fd21c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Flavor limits 0:0:0 {{(pid=120649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 30 19:29:26.841099 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.virt.hardware [None req-4f28b93f-cfb9-4fde-af4d-521a1a5fd21c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Image limits 0:0:0 {{(pid=120649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 30 19:29:26.841736 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.virt.hardware [None req-4f28b93f-cfb9-4fde-af4d-521a1a5fd21c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Flavor pref 0:0:0 {{(pid=120649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 30 19:29:26.842300 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.virt.hardware [None req-4f28b93f-cfb9-4fde-af4d-521a1a5fd21c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Image pref 0:0:0 {{(pid=120649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 30 19:29:26.842879 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.virt.hardware [None req-4f28b93f-cfb9-4fde-af4d-521a1a5fd21c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 30 19:29:26.849348 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-4a84ca2c-c8dd-4b4f-87a8-bfe969559da3 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] [instance: 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:26.888356 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4a84ca2c-c8dd-4b4f-87a8-bfe969559da3 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:26.890411 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4a84ca2c-c8dd-4b4f-87a8-bfe969559da3 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:26.892726 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4a84ca2c-c8dd-4b4f-87a8-bfe969559da3 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:26.894426 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4a84ca2c-c8dd-4b4f-87a8-bfe969559da3 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:26.897443 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4f28b93f-cfb9-4fde-af4d-521a1a5fd21c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:26.897955 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4f28b93f-cfb9-4fde-af4d-521a1a5fd21c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:26.898406 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4f28b93f-cfb9-4fde-af4d-521a1a5fd21c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:26.898623 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4a84ca2c-c8dd-4b4f-87a8-bfe969559da3 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:26.899143 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4f28b93f-cfb9-4fde-af4d-521a1a5fd21c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:26.899637 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4f28b93f-cfb9-4fde-af4d-521a1a5fd21c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:26.900032 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4f28b93f-cfb9-4fde-af4d-521a1a5fd21c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:26.900341 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4a84ca2c-c8dd-4b4f-87a8-bfe969559da3 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:26.990630 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.quota [None req-4f28b93f-cfb9-4fde-af4d-521a1a5fd21c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Getting quotas for project 612fb8a339e4478ba78bc5ef3b343b82. Resources: {'instances', 'ram', 'cores'} {{(pid=120649) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 30 19:29:27.006502 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.quota [None req-4f28b93f-cfb9-4fde-af4d-521a1a5fd21c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Getting quotas for user ccbdadc310fc4bf8a6679bcb39b34ff1 and project 612fb8a339e4478ba78bc5ef3b343b82. Resources: {'instances', 'ram', 'cores'} {{(pid=120649) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 30 19:29:27.048946 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-4f28b93f-cfb9-4fde-af4d-521a1a5fd21c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Going to run 1 instances... {{(pid=120649) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 30 19:29:27.062530 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-4f28b93f-cfb9-4fde-af4d-521a1a5fd21c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7714d055-7d2c-4f56-9b14-45324361e286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 30 19:29:27.345168 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-4f28b93f-cfb9-4fde-af4d-521a1a5fd21c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.883988 Sep 30 19:29:27.355949 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 15/54] 10.222.0.17 () {60 vars in 1147 bytes} [Fri Sep 30 19:29:24 2022] POST /compute/v2.1/servers => generated 401 bytes in 2899 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 30 19:29:27.391291 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-45e6c153-3a97-48bf-99fe-e9bb954233fe tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1193991716", "imageRef": "7714d055-7d2c-4f56-9b14-45324361e286", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e825309b-fa06-4059-8fbc-66e6421aaeab"}], "security_groups": [{"name": "tempest-securitygroup--1544930200"}], "key_name": "tempest-keypair-254540382", "user_data": "}} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:29:27.542583 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-4a84ca2c-c8dd-4b4f-87a8-bfe969559da3 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bb718f9153493ca6dda343d461c5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9758637e30e4089b394ed6ea5c2cf3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:27.610194 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-4a84ca2c-c8dd-4b4f-87a8-bfe969559da3 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] 10.222.0.17 "GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf" status: 200 len: 1273 microversion: 2.1 time: 0.781885 Sep 30 19:29:27.613476 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 40/55] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:26 2022] GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf => generated 1273 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:27.619835 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e867e990-e205-4b66-898b-d62f81c9b2e8 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:27.629082 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-e867e990-e205-4b66-898b-d62f81c9b2e8 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:27.956229 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-e867e990-e205-4b66-898b-d62f81c9b2e8 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:27.968512 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-e867e990-e205-4b66-898b-d62f81c9b2e8 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1222 microversion: 2.1 time: 0.353563 Sep 30 19:29:27.974223 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 41/56] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:27 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1222 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:27.990435 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-d5f7b0bb-40ec-4052-b626-061c4f383521 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:27.992081 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-d5f7b0bb-40ec-4052-b626-061c4f383521 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:28.316252 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-d5f7b0bb-40ec-4052-b626-061c4f383521 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:28.338679 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-d5f7b0bb-40ec-4052-b626-061c4f383521 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d" status: 200 len: 1241 microversion: 2.1 time: 0.361265 Sep 30 19:29:28.359612 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 42/57] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:27 2022] GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d => generated 1241 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:28.461098 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.network.neutron [None req-45e6c153-3a97-48bf-99fe-e9bb954233fe tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] validate_networks() for [('e825309b-fa06-4059-8fbc-66e6421aaeab', None, None, None, None, None)] {{(pid=120649) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 30 19:29:28.639233 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-da22127b-4ef0-4a2f-88cf-99077515ad06 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:28.640901 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-da22127b-4ef0-4a2f-88cf-99077515ad06 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] [instance: 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:28.655037 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-da22127b-4ef0-4a2f-88cf-99077515ad06 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:28.658253 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-da22127b-4ef0-4a2f-88cf-99077515ad06 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:28.659022 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-da22127b-4ef0-4a2f-88cf-99077515ad06 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:28.663309 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-da22127b-4ef0-4a2f-88cf-99077515ad06 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:28.665470 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-da22127b-4ef0-4a2f-88cf-99077515ad06 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:28.668480 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-da22127b-4ef0-4a2f-88cf-99077515ad06 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:29.215660 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-da22127b-4ef0-4a2f-88cf-99077515ad06 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bb718f9153493ca6dda343d461c5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9758637e30e4089b394ed6ea5c2cf3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:29.225431 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-da22127b-4ef0-4a2f-88cf-99077515ad06 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] 10.222.0.17 "GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf" status: 200 len: 1273 microversion: 2.1 time: 0.590299 Sep 30 19:29:29.233066 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 43/58] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:28 2022] GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf => generated 1273 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:29.259563 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-7c48859a-8adb-42b2-9310-f202c3540b0d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:29.262060 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-7c48859a-8adb-42b2-9310-f202c3540b0d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:29.277866 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7c48859a-8adb-42b2-9310-f202c3540b0d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:29.279893 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7c48859a-8adb-42b2-9310-f202c3540b0d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:29.280885 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7c48859a-8adb-42b2-9310-f202c3540b0d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:29.282064 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7c48859a-8adb-42b2-9310-f202c3540b0d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:29.286338 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7c48859a-8adb-42b2-9310-f202c3540b0d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:29.286995 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7c48859a-8adb-42b2-9310-f202c3540b0d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:29.788430 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-7c48859a-8adb-42b2-9310-f202c3540b0d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:29.802181 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-7c48859a-8adb-42b2-9310-f202c3540b0d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1274 microversion: 2.1 time: 0.561662 Sep 30 19:29:29.803349 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 44/59] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:29 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1274 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:29.857222 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-14604f31-a476-4de3-acd7-de8b8348a6ff tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:29.859209 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-14604f31-a476-4de3-acd7-de8b8348a6ff tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:29.878936 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-14604f31-a476-4de3-acd7-de8b8348a6ff tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:29.880686 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-14604f31-a476-4de3-acd7-de8b8348a6ff tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:29.882336 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-14604f31-a476-4de3-acd7-de8b8348a6ff tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:29.888162 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-14604f31-a476-4de3-acd7-de8b8348a6ff tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:29.889141 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-14604f31-a476-4de3-acd7-de8b8348a6ff tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:29.890022 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-14604f31-a476-4de3-acd7-de8b8348a6ff tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:30.434771 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-14604f31-a476-4de3-acd7-de8b8348a6ff tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:30.448675 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-14604f31-a476-4de3-acd7-de8b8348a6ff tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d" status: 200 len: 1293 microversion: 2.1 time: 0.625113 Sep 30 19:29:30.450131 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 45/60] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:29 2022] GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d => generated 1293 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:30.462912 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-72c72de4-0dae-4188-8196-55b86844b4cc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-57347157", "imageRef": "7714d055-7d2c-4f56-9b14-45324361e286", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bccaac20-0d1c-4bfe-8b48-c5f621cada91"}], "security_groups": [{"name": "tempest-securitygroup--1202439802"}], "key_name": "tempest-keypair-1346387074", "user_data": "}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:29:30.990012 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.network.neutron [None req-72c72de4-0dae-4188-8196-55b86844b4cc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] validate_networks() for [('bccaac20-0d1c-4bfe-8b48-c5f621cada91', None, None, None, None, None)] {{(pid=120648) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 30 19:29:31.650625 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.virt.hardware [None req-45e6c153-3a97-48bf-99fe-e9bb954233fe tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Flavor limits 0:0:0 {{(pid=120649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 30 19:29:31.651267 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.virt.hardware [None req-45e6c153-3a97-48bf-99fe-e9bb954233fe tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Image limits 0:0:0 {{(pid=120649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 30 19:29:31.651927 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.virt.hardware [None req-45e6c153-3a97-48bf-99fe-e9bb954233fe tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Flavor pref 0:0:0 {{(pid=120649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 30 19:29:31.652632 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.virt.hardware [None req-45e6c153-3a97-48bf-99fe-e9bb954233fe tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Image pref 0:0:0 {{(pid=120649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 30 19:29:31.653192 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.virt.hardware [None req-45e6c153-3a97-48bf-99fe-e9bb954233fe tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 30 19:29:31.669262 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-45e6c153-3a97-48bf-99fe-e9bb954233fe tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:31.672320 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-45e6c153-3a97-48bf-99fe-e9bb954233fe tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:31.673748 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-45e6c153-3a97-48bf-99fe-e9bb954233fe tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:31.675347 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-45e6c153-3a97-48bf-99fe-e9bb954233fe tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:31.676140 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-45e6c153-3a97-48bf-99fe-e9bb954233fe tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:31.678571 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-45e6c153-3a97-48bf-99fe-e9bb954233fe tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:31.724426 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.quota [None req-45e6c153-3a97-48bf-99fe-e9bb954233fe tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Getting quotas for project ac5815ead619491680fb44af178e9cc0. Resources: {'instances', 'ram', 'cores'} {{(pid=120649) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 30 19:29:31.752825 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.quota [None req-45e6c153-3a97-48bf-99fe-e9bb954233fe tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Getting quotas for user a397314cdd52409c920071ae009516af and project ac5815ead619491680fb44af178e9cc0. Resources: {'instances', 'ram', 'cores'} {{(pid=120649) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 30 19:29:31.775156 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-45e6c153-3a97-48bf-99fe-e9bb954233fe tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Going to run 1 instances... {{(pid=120649) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 30 19:29:31.778330 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-45e6c153-3a97-48bf-99fe-e9bb954233fe tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7714d055-7d2c-4f56-9b14-45324361e286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 30 19:29:31.867173 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-45e6c153-3a97-48bf-99fe-e9bb954233fe tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.509043 Sep 30 19:29:31.867822 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 16/61] 10.222.0.17 () {60 vars in 1147 bytes} [Fri Sep 30 19:29:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 4511 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 30 19:29:31.880135 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-3ccf8e48-fbeb-4cbd-be73-3d558e0e7969 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:31.881729 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-3ccf8e48-fbeb-4cbd-be73-3d558e0e7969 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] [instance: 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:31.898225 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3ccf8e48-fbeb-4cbd-be73-3d558e0e7969 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:31.898758 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3ccf8e48-fbeb-4cbd-be73-3d558e0e7969 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:31.899185 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3ccf8e48-fbeb-4cbd-be73-3d558e0e7969 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:31.901178 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3ccf8e48-fbeb-4cbd-be73-3d558e0e7969 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:31.901803 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3ccf8e48-fbeb-4cbd-be73-3d558e0e7969 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:31.902425 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3ccf8e48-fbeb-4cbd-be73-3d558e0e7969 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:31.962417 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-72c72de4-0dae-4188-8196-55b86844b4cc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Flavor limits 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 30 19:29:31.963214 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-72c72de4-0dae-4188-8196-55b86844b4cc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Image limits 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 30 19:29:31.963983 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-72c72de4-0dae-4188-8196-55b86844b4cc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Flavor pref 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 30 19:29:31.964993 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-72c72de4-0dae-4188-8196-55b86844b4cc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Image pref 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 30 19:29:31.965759 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-72c72de4-0dae-4188-8196-55b86844b4cc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 30 19:29:31.983403 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-72c72de4-0dae-4188-8196-55b86844b4cc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:31.985729 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-72c72de4-0dae-4188-8196-55b86844b4cc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:31.987196 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-72c72de4-0dae-4188-8196-55b86844b4cc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:31.988722 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-72c72de4-0dae-4188-8196-55b86844b4cc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:31.989477 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-72c72de4-0dae-4188-8196-55b86844b4cc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:31.990641 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-72c72de4-0dae-4188-8196-55b86844b4cc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:32.021250 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-72c72de4-0dae-4188-8196-55b86844b4cc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Getting quotas for project 395bb9b09f7948bbad5817c88aa4accc. Resources: {'instances', 'ram', 'cores'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 30 19:29:32.027048 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-72c72de4-0dae-4188-8196-55b86844b4cc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Getting quotas for user f7aa40f3966d4c97ab6a1a764722969d and project 395bb9b09f7948bbad5817c88aa4accc. Resources: {'instances', 'ram', 'cores'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 30 19:29:32.043069 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-72c72de4-0dae-4188-8196-55b86844b4cc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Going to run 1 instances... {{(pid=120648) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 30 19:29:32.045950 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-72c72de4-0dae-4188-8196-55b86844b4cc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7714d055-7d2c-4f56-9b14-45324361e286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 30 19:29:32.150204 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-72c72de4-0dae-4188-8196-55b86844b4cc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.686850 Sep 30 19:29:32.152543 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 46/62] 10.222.0.17 () {62 vars in 1188 bytes} [Fri Sep 30 19:29:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 1696 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 30 19:29:32.161165 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-22c5204a-dd5a-4b38-b286-73bb001eebcc tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:32.161790 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-22c5204a-dd5a-4b38-b286-73bb001eebcc tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:32.169057 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-22c5204a-dd5a-4b38-b286-73bb001eebcc tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:32.170380 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-22c5204a-dd5a-4b38-b286-73bb001eebcc tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:32.171171 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-22c5204a-dd5a-4b38-b286-73bb001eebcc tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:32.171576 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-22c5204a-dd5a-4b38-b286-73bb001eebcc tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:32.172023 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-22c5204a-dd5a-4b38-b286-73bb001eebcc tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:32.172474 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-22c5204a-dd5a-4b38-b286-73bb001eebcc tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:32.276718 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-3ccf8e48-fbeb-4cbd-be73-3d558e0e7969 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bb718f9153493ca6dda343d461c5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9758637e30e4089b394ed6ea5c2cf3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:32.291055 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-3ccf8e48-fbeb-4cbd-be73-3d558e0e7969 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] 10.222.0.17 "GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf" status: 200 len: 1315 microversion: 2.1 time: 0.418169 Sep 30 19:29:32.299629 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 17/63] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:31 2022] GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf => generated 1315 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:32.310537 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-c9aa4c05-27c7-482b-a4f3-8dbe991c5599 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:32.311328 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-c9aa4c05-27c7-482b-a4f3-8dbe991c5599 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:32.329475 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c9aa4c05-27c7-482b-a4f3-8dbe991c5599 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:32.329978 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c9aa4c05-27c7-482b-a4f3-8dbe991c5599 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:32.330420 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c9aa4c05-27c7-482b-a4f3-8dbe991c5599 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:32.331130 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c9aa4c05-27c7-482b-a4f3-8dbe991c5599 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:32.331585 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c9aa4c05-27c7-482b-a4f3-8dbe991c5599 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:32.332014 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c9aa4c05-27c7-482b-a4f3-8dbe991c5599 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:32.358006 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-22c5204a-dd5a-4b38-b286-73bb001eebcc tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:32.391308 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-22c5204a-dd5a-4b38-b286-73bb001eebcc tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1280 microversion: 2.1 time: 0.237556 Sep 30 19:29:32.408394 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 47/64] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:32 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1280 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:32.411538 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-0dcf6a0a-7742-4e87-9a29-5410a9394fb1 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:32.413695 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-0dcf6a0a-7742-4e87-9a29-5410a9394fb1 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:32.444436 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:32.507246 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-c9aa4c05-27c7-482b-a4f3-8dbe991c5599 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:32.516802 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-c9aa4c05-27c7-482b-a4f3-8dbe991c5599 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d" status: 200 len: 1293 microversion: 2.1 time: 0.215692 Sep 30 19:29:32.523067 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 18/65] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:32 2022] GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d => generated 1293 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:32.528986 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-a99d2324-92ed-458e-9a6d-e24dd63f4c75 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:32.529889 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-a99d2324-92ed-458e-9a6d-e24dd63f4c75 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:32.539133 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-0dcf6a0a-7742-4e87-9a29-5410a9394fb1 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:32.547991 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-0dcf6a0a-7742-4e87-9a29-5410a9394fb1 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1237 microversion: 2.1 time: 0.152772 Sep 30 19:29:32.549268 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 48/66] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:32 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1237 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:32.658635 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-a99d2324-92ed-458e-9a6d-e24dd63f4c75 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:32.682216 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-a99d2324-92ed-458e-9a6d-e24dd63f4c75 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:32.688758 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-a99d2324-92ed-458e-9a6d-e24dd63f4c75 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:32.692763 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-a99d2324-92ed-458e-9a6d-e24dd63f4c75 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1280 microversion: 2.20 time: 0.166692 Sep 30 19:29:32.706736 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 19/67] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:29:32 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1280 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:29:32.820100 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-db56fdab-3698-44e9-bcf2-307433b56dfd req-7bda6948-877b-4a94-8b7e-c9fd825fcfae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fd6c296-8008-4f27-82c0-36839a4eec3f", "tag": "6ac4279f-c732-4cbf-8ee8-224018cd79f8"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:29:32.851842 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-db56fdab-3698-44e9-bcf2-307433b56dfd req-7bda6948-877b-4a94-8b7e-c9fd825fcfae service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:32.861783 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-db56fdab-3698-44e9-bcf2-307433b56dfd req-7bda6948-877b-4a94-8b7e-c9fd825fcfae service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:32.866855 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-db56fdab-3698-44e9-bcf2-307433b56dfd req-7bda6948-877b-4a94-8b7e-c9fd825fcfae service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:32.919103 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-db56fdab-3698-44e9-bcf2-307433b56dfd req-7bda6948-877b-4a94-8b7e-c9fd825fcfae service nova] Creating event network-changed:6ac4279f-c732-4cbf-8ee8-224018cd79f8 for instance 5fd6c296-8008-4f27-82c0-36839a4eec3f on hv-cinder-86001 Sep 30 19:29:32.919641 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-db56fdab-3698-44e9-bcf2-307433b56dfd req-7bda6948-877b-4a94-8b7e-c9fd825fcfae service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120648) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 30 19:29:32.920037 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-db56fdab-3698-44e9-bcf2-307433b56dfd req-7bda6948-877b-4a94-8b7e-c9fd825fcfae service nova] Acquired lock "compute-rpcapi-router" {{(pid=120648) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 30 19:29:32.921117 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d1e3d592-4fe0-49b2-85a6-200872474f2c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:32.921589 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d1e3d592-4fe0-49b2-85a6-200872474f2c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:32.922015 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d1e3d592-4fe0-49b2-85a6-200872474f2c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:32.922738 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d1e3d592-4fe0-49b2-85a6-200872474f2c None None] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:32.931992 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d1e3d592-4fe0-49b2-85a6-200872474f2c None None] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:32.932172 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d1e3d592-4fe0-49b2-85a6-200872474f2c None None] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:32.948890 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.compute.rpcapi [None req-d1e3d592-4fe0-49b2-85a6-200872474f2c None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 30 19:29:32.949886 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d1e3d592-4fe0-49b2-85a6-200872474f2c None None] Releasing lock "compute-rpcapi-router" {{(pid=120648) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 30 19:29:32.975338 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-d1e3d592-4fe0-49b2-85a6-200872474f2c None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.424606 Sep 30 19:29:32.975937 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 49/68] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:29:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:29:33.316061 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-c2beb681-15fb-4195-9743-449c0b424d31 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:33.318211 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-c2beb681-15fb-4195-9743-449c0b424d31 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] [instance: 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:33.343359 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c2beb681-15fb-4195-9743-449c0b424d31 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:33.344022 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c2beb681-15fb-4195-9743-449c0b424d31 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:33.344489 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c2beb681-15fb-4195-9743-449c0b424d31 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:33.345213 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c2beb681-15fb-4195-9743-449c0b424d31 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:33.345674 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c2beb681-15fb-4195-9743-449c0b424d31 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:33.346100 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c2beb681-15fb-4195-9743-449c0b424d31 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:33.419054 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-1ccdb831-8c90-4373-b4b3-8ea386a08b77 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:33.419754 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-1ccdb831-8c90-4373-b4b3-8ea386a08b77 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:33.427830 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1ccdb831-8c90-4373-b4b3-8ea386a08b77 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:33.428587 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1ccdb831-8c90-4373-b4b3-8ea386a08b77 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:33.433699 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1ccdb831-8c90-4373-b4b3-8ea386a08b77 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:33.434478 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1ccdb831-8c90-4373-b4b3-8ea386a08b77 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:33.435052 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1ccdb831-8c90-4373-b4b3-8ea386a08b77 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:33.435508 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1ccdb831-8c90-4373-b4b3-8ea386a08b77 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:33.513261 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-c2beb681-15fb-4195-9743-449c0b424d31 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bb718f9153493ca6dda343d461c5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9758637e30e4089b394ed6ea5c2cf3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:33.522096 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-c2beb681-15fb-4195-9743-449c0b424d31 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] 10.222.0.17 "GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf" status: 200 len: 1315 microversion: 2.1 time: 0.210694 Sep 30 19:29:33.522812 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 20/69] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:33 2022] GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:33.537522 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-1ccdb831-8c90-4373-b4b3-8ea386a08b77 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:33.546481 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-1ccdb831-8c90-4373-b4b3-8ea386a08b77 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1280 microversion: 2.1 time: 0.131922 Sep 30 19:29:33.547107 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 50/70] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:33 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1280 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:29:33.562090 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-60e322c5-5577-43f6-8246-d0a981520193 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:33.563008 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-60e322c5-5577-43f6-8246-d0a981520193 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:33.574298 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-60e322c5-5577-43f6-8246-d0a981520193 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:33.574802 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-60e322c5-5577-43f6-8246-d0a981520193 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:33.575255 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-60e322c5-5577-43f6-8246-d0a981520193 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:33.576004 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-60e322c5-5577-43f6-8246-d0a981520193 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:33.576082 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-9eb8a893-118e-432f-8015-8467c8f9cd6a tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:33.576443 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-60e322c5-5577-43f6-8246-d0a981520193 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:33.576867 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-9eb8a893-118e-432f-8015-8467c8f9cd6a tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:33.576991 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-60e322c5-5577-43f6-8246-d0a981520193 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:33.584263 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9eb8a893-118e-432f-8015-8467c8f9cd6a tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:33.585131 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9eb8a893-118e-432f-8015-8467c8f9cd6a tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:33.585769 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9eb8a893-118e-432f-8015-8467c8f9cd6a tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:33.586619 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9eb8a893-118e-432f-8015-8467c8f9cd6a tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:33.587248 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9eb8a893-118e-432f-8015-8467c8f9cd6a tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:33.587902 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9eb8a893-118e-432f-8015-8467c8f9cd6a tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:33.655775 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-9eb8a893-118e-432f-8015-8467c8f9cd6a tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:33.666199 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-9eb8a893-118e-432f-8015-8467c8f9cd6a tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1241 microversion: 2.1 time: 0.094772 Sep 30 19:29:33.680862 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-60e322c5-5577-43f6-8246-d0a981520193 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:33.681442 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 51/71] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:33 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1241 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:29:33.694857 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-60e322c5-5577-43f6-8246-d0a981520193 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d" status: 200 len: 1293 microversion: 2.1 time: 0.151608 Sep 30 19:29:33.696075 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 21/72] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:33 2022] GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d => generated 1293 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:29:33.723808 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-3077cbe1-f718-408f-90f1-afff07acfba4 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:33.724725 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-3077cbe1-f718-408f-90f1-afff07acfba4 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:33.731736 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3077cbe1-f718-408f-90f1-afff07acfba4 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:33.732562 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3077cbe1-f718-408f-90f1-afff07acfba4 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:33.733223 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3077cbe1-f718-408f-90f1-afff07acfba4 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:33.734796 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3077cbe1-f718-408f-90f1-afff07acfba4 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:33.735442 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3077cbe1-f718-408f-90f1-afff07acfba4 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:33.736337 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3077cbe1-f718-408f-90f1-afff07acfba4 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:33.811330 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-3077cbe1-f718-408f-90f1-afff07acfba4 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:33.821636 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-3077cbe1-f718-408f-90f1-afff07acfba4 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:33.823082 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-3077cbe1-f718-408f-90f1-afff07acfba4 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:33.824202 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-3077cbe1-f718-408f-90f1-afff07acfba4 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1284 microversion: 2.20 time: 0.105143 Sep 30 19:29:33.825097 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 52/73] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:29:33 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:29:34.547414 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-3492aa7c-99f0-44aa-8818-98b9e1d07829 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:34.548046 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-3492aa7c-99f0-44aa-8818-98b9e1d07829 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] [instance: 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:34.554879 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3492aa7c-99f0-44aa-8818-98b9e1d07829 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:34.555364 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3492aa7c-99f0-44aa-8818-98b9e1d07829 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:34.555805 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3492aa7c-99f0-44aa-8818-98b9e1d07829 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:34.556751 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3492aa7c-99f0-44aa-8818-98b9e1d07829 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:34.557213 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3492aa7c-99f0-44aa-8818-98b9e1d07829 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:34.557690 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3492aa7c-99f0-44aa-8818-98b9e1d07829 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:34.569824 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-73f107b2-ca79-4c1f-b044-9ce402a5f63d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:34.570603 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-73f107b2-ca79-4c1f-b044-9ce402a5f63d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:34.577297 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-73f107b2-ca79-4c1f-b044-9ce402a5f63d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:34.577960 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-73f107b2-ca79-4c1f-b044-9ce402a5f63d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:34.578450 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-73f107b2-ca79-4c1f-b044-9ce402a5f63d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:34.579423 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-73f107b2-ca79-4c1f-b044-9ce402a5f63d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:34.579932 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-73f107b2-ca79-4c1f-b044-9ce402a5f63d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:34.580454 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-73f107b2-ca79-4c1f-b044-9ce402a5f63d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:34.654799 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-73f107b2-ca79-4c1f-b044-9ce402a5f63d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:34.663895 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-73f107b2-ca79-4c1f-b044-9ce402a5f63d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1280 microversion: 2.1 time: 0.098205 Sep 30 19:29:34.664558 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 53/74] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:34 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1280 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:29:34.689717 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-c0207930-352b-4e7b-87a0-c87fabd2f9f9 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:34.690341 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-c0207930-352b-4e7b-87a0-c87fabd2f9f9 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:34.696573 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c0207930-352b-4e7b-87a0-c87fabd2f9f9 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:34.697450 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c0207930-352b-4e7b-87a0-c87fabd2f9f9 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:34.698029 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c0207930-352b-4e7b-87a0-c87fabd2f9f9 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:34.699003 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c0207930-352b-4e7b-87a0-c87fabd2f9f9 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:34.699468 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c0207930-352b-4e7b-87a0-c87fabd2f9f9 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:34.700596 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c0207930-352b-4e7b-87a0-c87fabd2f9f9 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:34.709084 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-3492aa7c-99f0-44aa-8818-98b9e1d07829 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bb718f9153493ca6dda343d461c5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9758637e30e4089b394ed6ea5c2cf3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:34.718100 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-3492aa7c-99f0-44aa-8818-98b9e1d07829 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] 10.222.0.17 "GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf" status: 200 len: 1315 microversion: 2.1 time: 0.174618 Sep 30 19:29:34.718915 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 22/75] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:34 2022] GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:34.724182 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-495e5cb8-aa39-4e5a-8ed1-96c89a8ce14b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:34.725068 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-495e5cb8-aa39-4e5a-8ed1-96c89a8ce14b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:34.731324 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-495e5cb8-aa39-4e5a-8ed1-96c89a8ce14b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:34.732109 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-495e5cb8-aa39-4e5a-8ed1-96c89a8ce14b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:34.732810 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-495e5cb8-aa39-4e5a-8ed1-96c89a8ce14b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:34.733746 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-495e5cb8-aa39-4e5a-8ed1-96c89a8ce14b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:34.734553 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-495e5cb8-aa39-4e5a-8ed1-96c89a8ce14b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:34.735055 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-495e5cb8-aa39-4e5a-8ed1-96c89a8ce14b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:34.769724 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-c0207930-352b-4e7b-87a0-c87fabd2f9f9 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:34.778676 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-c0207930-352b-4e7b-87a0-c87fabd2f9f9 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1241 microversion: 2.1 time: 0.092607 Sep 30 19:29:34.779474 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 54/76] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:34 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1241 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:29:34.800897 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-495e5cb8-aa39-4e5a-8ed1-96c89a8ce14b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:34.809343 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-495e5cb8-aa39-4e5a-8ed1-96c89a8ce14b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d" status: 200 len: 1293 microversion: 2.1 time: 0.089210 Sep 30 19:29:34.810000 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 23/77] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:34 2022] GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d => generated 1293 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:34.859386 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-68559ca6-a9cb-4f23-87e4-1f5ab0ef7330 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:34.860045 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-68559ca6-a9cb-4f23-87e4-1f5ab0ef7330 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:34.865967 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-68559ca6-a9cb-4f23-87e4-1f5ab0ef7330 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:34.866564 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-68559ca6-a9cb-4f23-87e4-1f5ab0ef7330 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:34.867023 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-68559ca6-a9cb-4f23-87e4-1f5ab0ef7330 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:34.867711 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-68559ca6-a9cb-4f23-87e4-1f5ab0ef7330 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:34.868161 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-68559ca6-a9cb-4f23-87e4-1f5ab0ef7330 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:34.868610 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-68559ca6-a9cb-4f23-87e4-1f5ab0ef7330 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:34.967880 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-68559ca6-a9cb-4f23-87e4-1f5ab0ef7330 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:34.982867 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-68559ca6-a9cb-4f23-87e4-1f5ab0ef7330 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:34.987219 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-68559ca6-a9cb-4f23-87e4-1f5ab0ef7330 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:35.004489 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-68559ca6-a9cb-4f23-87e4-1f5ab0ef7330 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1284 microversion: 2.20 time: 0.149105 Sep 30 19:29:35.020909 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 55/78] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:29:34 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1284 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:29:35.687033 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-9d0b66e4-4e15-4124-8479-20c6e895db1a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:35.687648 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-9d0b66e4-4e15-4124-8479-20c6e895db1a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:35.698685 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9d0b66e4-4e15-4124-8479-20c6e895db1a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:35.699452 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9d0b66e4-4e15-4124-8479-20c6e895db1a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:35.701003 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9d0b66e4-4e15-4124-8479-20c6e895db1a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:35.702536 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9d0b66e4-4e15-4124-8479-20c6e895db1a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:35.703272 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9d0b66e4-4e15-4124-8479-20c6e895db1a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:35.703912 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9d0b66e4-4e15-4124-8479-20c6e895db1a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:35.742410 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-2b815ff6-7722-4793-97f3-17f1f510b23f tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:35.743020 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-2b815ff6-7722-4793-97f3-17f1f510b23f tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] [instance: 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:35.759740 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2b815ff6-7722-4793-97f3-17f1f510b23f tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:35.763124 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2b815ff6-7722-4793-97f3-17f1f510b23f tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:35.763624 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2b815ff6-7722-4793-97f3-17f1f510b23f tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:35.769327 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2b815ff6-7722-4793-97f3-17f1f510b23f tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:35.770354 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2b815ff6-7722-4793-97f3-17f1f510b23f tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:35.774226 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2b815ff6-7722-4793-97f3-17f1f510b23f tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:35.797334 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-9d0b66e4-4e15-4124-8479-20c6e895db1a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:35.815672 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-9d0b66e4-4e15-4124-8479-20c6e895db1a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1280 microversion: 2.1 time: 0.132368 Sep 30 19:29:35.816874 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 24/79] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:35 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1280 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:35.832107 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-8ec20d2a-11b3-48a8-b326-476de731224d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:35.833113 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-8ec20d2a-11b3-48a8-b326-476de731224d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:35.840612 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8ec20d2a-11b3-48a8-b326-476de731224d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:35.841732 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8ec20d2a-11b3-48a8-b326-476de731224d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:35.843169 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8ec20d2a-11b3-48a8-b326-476de731224d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:35.844884 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8ec20d2a-11b3-48a8-b326-476de731224d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:35.846019 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8ec20d2a-11b3-48a8-b326-476de731224d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:35.846554 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8ec20d2a-11b3-48a8-b326-476de731224d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:35.965621 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-8ec20d2a-11b3-48a8-b326-476de731224d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:35.974681 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-8ec20d2a-11b3-48a8-b326-476de731224d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1241 microversion: 2.1 time: 0.156152 Sep 30 19:29:35.975670 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 25/80] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:35 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1241 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:35.983922 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-2b815ff6-7722-4793-97f3-17f1f510b23f tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bb718f9153493ca6dda343d461c5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9758637e30e4089b394ed6ea5c2cf3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:35.998827 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-48cdcfce-5080-4dce-a731-8b2533c13128 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:35.999945 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-48cdcfce-5080-4dce-a731-8b2533c13128 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:36.002628 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-2b815ff6-7722-4793-97f3-17f1f510b23f tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] 10.222.0.17 "GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf" status: 200 len: 1315 microversion: 2.1 time: 0.260961 Sep 30 19:29:36.004998 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 56/81] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:35 2022] GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:36.006994 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:36.017080 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-48cdcfce-5080-4dce-a731-8b2533c13128 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:36.018058 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-48cdcfce-5080-4dce-a731-8b2533c13128 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:36.018638 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-48cdcfce-5080-4dce-a731-8b2533c13128 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:36.019532 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-48cdcfce-5080-4dce-a731-8b2533c13128 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:36.020386 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-48cdcfce-5080-4dce-a731-8b2533c13128 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:36.024085 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-48cdcfce-5080-4dce-a731-8b2533c13128 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:36.031164 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-95374128-423d-44ee-80ad-96d3ed2c0379 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:36.032020 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-95374128-423d-44ee-80ad-96d3ed2c0379 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:36.048466 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-95374128-423d-44ee-80ad-96d3ed2c0379 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:36.049100 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-95374128-423d-44ee-80ad-96d3ed2c0379 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:36.049614 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-95374128-423d-44ee-80ad-96d3ed2c0379 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:36.050824 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-95374128-423d-44ee-80ad-96d3ed2c0379 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:36.051699 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-95374128-423d-44ee-80ad-96d3ed2c0379 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:36.052277 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-95374128-423d-44ee-80ad-96d3ed2c0379 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:36.124068 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-48cdcfce-5080-4dce-a731-8b2533c13128 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:36.132532 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-48cdcfce-5080-4dce-a731-8b2533c13128 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d" status: 200 len: 1301 microversion: 2.1 time: 0.155537 Sep 30 19:29:36.140236 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 26/82] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:35 2022] GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d => generated 1301 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:36.156437 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-95374128-423d-44ee-80ad-96d3ed2c0379 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:36.171528 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-95374128-423d-44ee-80ad-96d3ed2c0379 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:36.173469 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-95374128-423d-44ee-80ad-96d3ed2c0379 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:36.174777 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-95374128-423d-44ee-80ad-96d3ed2c0379 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1284 microversion: 2.20 time: 0.147618 Sep 30 19:29:36.188400 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 57/83] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:29:36 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1284 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:29:36.838985 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-a146c385-405c-4ea7-8994-e3c04c9f49e5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:36.839497 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-a146c385-405c-4ea7-8994-e3c04c9f49e5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:36.846452 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a146c385-405c-4ea7-8994-e3c04c9f49e5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:36.847142 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a146c385-405c-4ea7-8994-e3c04c9f49e5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:36.847809 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a146c385-405c-4ea7-8994-e3c04c9f49e5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:36.849903 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a146c385-405c-4ea7-8994-e3c04c9f49e5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:36.850578 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a146c385-405c-4ea7-8994-e3c04c9f49e5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:36.851189 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a146c385-405c-4ea7-8994-e3c04c9f49e5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:36.950674 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-a146c385-405c-4ea7-8994-e3c04c9f49e5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:36.960691 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-a146c385-405c-4ea7-8994-e3c04c9f49e5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1280 microversion: 2.1 time: 0.125323 Sep 30 19:29:36.962285 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 27/84] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:36 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1280 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:36.998791 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-bbaa1d23-319f-4424-986d-75afc7f249cc tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:36.999408 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-bbaa1d23-319f-4424-986d-75afc7f249cc tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:37.010832 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bbaa1d23-319f-4424-986d-75afc7f249cc tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:37.012713 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bbaa1d23-319f-4424-986d-75afc7f249cc tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:37.013861 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bbaa1d23-319f-4424-986d-75afc7f249cc tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:37.015152 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bbaa1d23-319f-4424-986d-75afc7f249cc tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:37.015882 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bbaa1d23-319f-4424-986d-75afc7f249cc tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:37.016295 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bbaa1d23-319f-4424-986d-75afc7f249cc tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:37.045383 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-fdf41f1a-7f90-402c-8da4-19f72b68d6a2 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:37.046332 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-fdf41f1a-7f90-402c-8da4-19f72b68d6a2 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] [instance: 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:37.059490 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-fdf41f1a-7f90-402c-8da4-19f72b68d6a2 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:37.060848 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-fdf41f1a-7f90-402c-8da4-19f72b68d6a2 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:37.061516 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-fdf41f1a-7f90-402c-8da4-19f72b68d6a2 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:37.063679 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-fdf41f1a-7f90-402c-8da4-19f72b68d6a2 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:37.064322 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-fdf41f1a-7f90-402c-8da4-19f72b68d6a2 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:37.066750 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-fdf41f1a-7f90-402c-8da4-19f72b68d6a2 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:37.182175 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-bbaa1d23-319f-4424-986d-75afc7f249cc tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:37.202573 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-bbaa1d23-319f-4424-986d-75afc7f249cc tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1241 microversion: 2.1 time: 0.207937 Sep 30 19:29:37.203407 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 58/85] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:36 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1241 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:37.224232 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-1d44d623-b5d5-4c62-af19-e5f669a16b56 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:37.240995 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-1d44d623-b5d5-4c62-af19-e5f669a16b56 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:37.247888 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1d44d623-b5d5-4c62-af19-e5f669a16b56 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:37.248738 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1d44d623-b5d5-4c62-af19-e5f669a16b56 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:37.249377 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1d44d623-b5d5-4c62-af19-e5f669a16b56 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:37.251887 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1d44d623-b5d5-4c62-af19-e5f669a16b56 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:37.252553 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1d44d623-b5d5-4c62-af19-e5f669a16b56 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:37.258606 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1d44d623-b5d5-4c62-af19-e5f669a16b56 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:37.313400 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-fdf41f1a-7f90-402c-8da4-19f72b68d6a2 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bb718f9153493ca6dda343d461c5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9758637e30e4089b394ed6ea5c2cf3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:37.344277 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-fdf41f1a-7f90-402c-8da4-19f72b68d6a2 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] 10.222.0.17 "GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf" status: 200 len: 1315 microversion: 2.1 time: 0.311144 Sep 30 19:29:37.362435 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 28/86] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:37 2022] GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:29:37.362435 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-c25cbcae-df37-4d54-bffb-7a88a608e0d0 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:37.362435 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-c25cbcae-df37-4d54-bffb-7a88a608e0d0 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:37.367715 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-1d44d623-b5d5-4c62-af19-e5f669a16b56 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:37.372164 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c25cbcae-df37-4d54-bffb-7a88a608e0d0 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:37.375016 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c25cbcae-df37-4d54-bffb-7a88a608e0d0 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:37.375544 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c25cbcae-df37-4d54-bffb-7a88a608e0d0 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:37.377187 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c25cbcae-df37-4d54-bffb-7a88a608e0d0 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:37.378862 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c25cbcae-df37-4d54-bffb-7a88a608e0d0 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:37.379442 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c25cbcae-df37-4d54-bffb-7a88a608e0d0 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:37.382100 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-1d44d623-b5d5-4c62-af19-e5f669a16b56 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d" status: 200 len: 1301 microversion: 2.1 time: 0.175636 Sep 30 19:29:37.397959 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 59/87] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:37 2022] GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d => generated 1301 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:37.497882 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-c25cbcae-df37-4d54-bffb-7a88a608e0d0 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:37.507942 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-c25cbcae-df37-4d54-bffb-7a88a608e0d0 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:37.510265 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-c25cbcae-df37-4d54-bffb-7a88a608e0d0 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:37.511457 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-c25cbcae-df37-4d54-bffb-7a88a608e0d0 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1284 microversion: 2.20 time: 0.162577 Sep 30 19:29:37.512041 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 29/88] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:29:37 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1284 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:29:37.989867 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-15dd8cf0-c695-488b-b0e1-d5935761f107 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:37.990479 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-15dd8cf0-c695-488b-b0e1-d5935761f107 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:37.996570 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-15dd8cf0-c695-488b-b0e1-d5935761f107 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:37.997430 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-15dd8cf0-c695-488b-b0e1-d5935761f107 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:37.998055 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-15dd8cf0-c695-488b-b0e1-d5935761f107 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:37.998971 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-15dd8cf0-c695-488b-b0e1-d5935761f107 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:38.000131 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-15dd8cf0-c695-488b-b0e1-d5935761f107 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:38.000768 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-15dd8cf0-c695-488b-b0e1-d5935761f107 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:38.005492 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=100 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:38.084039 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-15dd8cf0-c695-488b-b0e1-d5935761f107 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:38.099588 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-15dd8cf0-c695-488b-b0e1-d5935761f107 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1280 microversion: 2.1 time: 0.113917 Sep 30 19:29:38.101080 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 60/89] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:37 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1280 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:38.231818 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-e7692957-fc13-49d9-b286-846e49123b3d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:38.232501 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-e7692957-fc13-49d9-b286-846e49123b3d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:38.243534 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e7692957-fc13-49d9-b286-846e49123b3d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:38.244499 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e7692957-fc13-49d9-b286-846e49123b3d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:38.246796 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e7692957-fc13-49d9-b286-846e49123b3d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:38.252296 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e7692957-fc13-49d9-b286-846e49123b3d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:38.252857 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e7692957-fc13-49d9-b286-846e49123b3d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:38.253744 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e7692957-fc13-49d9-b286-846e49123b3d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:38.262387 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell1:SELECT=100 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:38.350267 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-e7692957-fc13-49d9-b286-846e49123b3d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:38.361912 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-e7692957-fc13-49d9-b286-846e49123b3d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1241 microversion: 2.1 time: 0.134119 Sep 30 19:29:38.363802 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 30/90] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:38 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1241 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:38.384959 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-5eae76f5-46b7-4c4e-97ee-0c7bf95544b6 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:38.388033 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-5eae76f5-46b7-4c4e-97ee-0c7bf95544b6 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] [instance: 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:38.396426 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5eae76f5-46b7-4c4e-97ee-0c7bf95544b6 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:38.397148 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5eae76f5-46b7-4c4e-97ee-0c7bf95544b6 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:38.397582 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5eae76f5-46b7-4c4e-97ee-0c7bf95544b6 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:38.399333 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5eae76f5-46b7-4c4e-97ee-0c7bf95544b6 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:38.399333 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5eae76f5-46b7-4c4e-97ee-0c7bf95544b6 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:38.405189 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-07611762-ff3c-4460-a92f-ed368232d3f3 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:38.409472 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-07611762-ff3c-4460-a92f-ed368232d3f3 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:38.416141 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5eae76f5-46b7-4c4e-97ee-0c7bf95544b6 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:38.421792 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-07611762-ff3c-4460-a92f-ed368232d3f3 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:38.422297 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-07611762-ff3c-4460-a92f-ed368232d3f3 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:38.422739 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-07611762-ff3c-4460-a92f-ed368232d3f3 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:38.427285 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-07611762-ff3c-4460-a92f-ed368232d3f3 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:38.428502 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-07611762-ff3c-4460-a92f-ed368232d3f3 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:38.429060 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-07611762-ff3c-4460-a92f-ed368232d3f3 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:38.541452 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-07611762-ff3c-4460-a92f-ed368232d3f3 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:38.550077 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-07611762-ff3c-4460-a92f-ed368232d3f3 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d" status: 200 len: 1301 microversion: 2.1 time: 0.148954 Sep 30 19:29:38.565034 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 31/91] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:38 2022] GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d => generated 1301 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:29:38.571182 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-66377dba-eb40-45ac-82a1-e8cc311fb3c6 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:38.571786 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-66377dba-eb40-45ac-82a1-e8cc311fb3c6 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:38.577747 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-66377dba-eb40-45ac-82a1-e8cc311fb3c6 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:38.578232 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-66377dba-eb40-45ac-82a1-e8cc311fb3c6 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:38.578664 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-66377dba-eb40-45ac-82a1-e8cc311fb3c6 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:38.579354 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-66377dba-eb40-45ac-82a1-e8cc311fb3c6 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:38.579807 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-66377dba-eb40-45ac-82a1-e8cc311fb3c6 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:38.580227 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-66377dba-eb40-45ac-82a1-e8cc311fb3c6 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:38.642258 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-66377dba-eb40-45ac-82a1-e8cc311fb3c6 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:38.652884 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-66377dba-eb40-45ac-82a1-e8cc311fb3c6 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:38.654548 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-66377dba-eb40-45ac-82a1-e8cc311fb3c6 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:38.655814 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-66377dba-eb40-45ac-82a1-e8cc311fb3c6 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1284 microversion: 2.20 time: 0.089746 Sep 30 19:29:38.667175 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-5eae76f5-46b7-4c4e-97ee-0c7bf95544b6 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bb718f9153493ca6dda343d461c5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9758637e30e4089b394ed6ea5c2cf3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:38.669906 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 32/92] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:29:38 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:29:38.675837 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-5eae76f5-46b7-4c4e-97ee-0c7bf95544b6 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] 10.222.0.17 "GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf" status: 200 len: 1315 microversion: 2.1 time: 0.304469 Sep 30 19:29:38.676741 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 61/93] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:38 2022] GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf => generated 1315 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:39.122693 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-0c2306fa-9dc4-4bcc-9993-34638c86ea69 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:39.123305 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-0c2306fa-9dc4-4bcc-9993-34638c86ea69 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:39.129389 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0c2306fa-9dc4-4bcc-9993-34638c86ea69 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:39.129892 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0c2306fa-9dc4-4bcc-9993-34638c86ea69 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:39.130364 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0c2306fa-9dc4-4bcc-9993-34638c86ea69 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:39.131068 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0c2306fa-9dc4-4bcc-9993-34638c86ea69 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:39.131599 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0c2306fa-9dc4-4bcc-9993-34638c86ea69 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:39.132147 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0c2306fa-9dc4-4bcc-9993-34638c86ea69 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:39.208739 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-0c2306fa-9dc4-4bcc-9993-34638c86ea69 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:39.216227 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-0c2306fa-9dc4-4bcc-9993-34638c86ea69 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1280 microversion: 2.1 time: 0.097467 Sep 30 19:29:39.228392 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 33/94] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:39 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1280 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:39.390368 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-97678f14-f667-4460-bd29-dab707ab93ab tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:39.391193 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-97678f14-f667-4460-bd29-dab707ab93ab tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:39.397779 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-97678f14-f667-4460-bd29-dab707ab93ab tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:39.398336 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-97678f14-f667-4460-bd29-dab707ab93ab tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:39.399019 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-97678f14-f667-4460-bd29-dab707ab93ab tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:39.399787 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-97678f14-f667-4460-bd29-dab707ab93ab tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:39.400309 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-97678f14-f667-4460-bd29-dab707ab93ab tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:39.400967 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-97678f14-f667-4460-bd29-dab707ab93ab tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:39.463305 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-97678f14-f667-4460-bd29-dab707ab93ab tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:39.471097 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-97678f14-f667-4460-bd29-dab707ab93ab tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1241 microversion: 2.1 time: 0.084555 Sep 30 19:29:39.471661 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 62/95] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:39 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:39.575112 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-f2b649ba-6c23-4a53-9523-9439264c84c7 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:39.575721 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-f2b649ba-6c23-4a53-9523-9439264c84c7 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:39.581776 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f2b649ba-6c23-4a53-9523-9439264c84c7 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:39.582361 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f2b649ba-6c23-4a53-9523-9439264c84c7 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:39.582855 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f2b649ba-6c23-4a53-9523-9439264c84c7 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:39.583546 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f2b649ba-6c23-4a53-9523-9439264c84c7 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:39.583997 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f2b649ba-6c23-4a53-9523-9439264c84c7 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:39.584447 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f2b649ba-6c23-4a53-9523-9439264c84c7 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:39.665132 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-f2b649ba-6c23-4a53-9523-9439264c84c7 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:39.673779 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-f2b649ba-6c23-4a53-9523-9439264c84c7 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d" status: 200 len: 1301 microversion: 2.1 time: 0.102625 Sep 30 19:29:39.675029 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 34/96] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:39 2022] GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d => generated 1301 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:39.686192 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-0680afce-c3c9-4ae7-a233-13f81578f1aa tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:39.686890 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-0680afce-c3c9-4ae7-a233-13f81578f1aa tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:39.696051 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0680afce-c3c9-4ae7-a233-13f81578f1aa tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:39.696736 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0680afce-c3c9-4ae7-a233-13f81578f1aa tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:39.697343 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0680afce-c3c9-4ae7-a233-13f81578f1aa tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:39.698359 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0680afce-c3c9-4ae7-a233-13f81578f1aa tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:39.698970 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0680afce-c3c9-4ae7-a233-13f81578f1aa tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:39.699640 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0680afce-c3c9-4ae7-a233-13f81578f1aa tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:39.704101 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-92d857a8-25fd-4f3e-a6d7-4ad0d1f28621 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:39.704813 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-92d857a8-25fd-4f3e-a6d7-4ad0d1f28621 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] [instance: 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:39.713614 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-92d857a8-25fd-4f3e-a6d7-4ad0d1f28621 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:39.716833 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-92d857a8-25fd-4f3e-a6d7-4ad0d1f28621 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:39.717440 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-92d857a8-25fd-4f3e-a6d7-4ad0d1f28621 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:39.719305 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-92d857a8-25fd-4f3e-a6d7-4ad0d1f28621 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:39.721146 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-92d857a8-25fd-4f3e-a6d7-4ad0d1f28621 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:39.722500 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-92d857a8-25fd-4f3e-a6d7-4ad0d1f28621 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:39.778573 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-0680afce-c3c9-4ae7-a233-13f81578f1aa tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:39.788057 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-0680afce-c3c9-4ae7-a233-13f81578f1aa tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:39.789549 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-0680afce-c3c9-4ae7-a233-13f81578f1aa tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:39.790688 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-0680afce-c3c9-4ae7-a233-13f81578f1aa tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1284 microversion: 2.20 time: 0.108920 Sep 30 19:29:39.791556 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 63/97] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:29:39 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:29:39.901723 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-92d857a8-25fd-4f3e-a6d7-4ad0d1f28621 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bb718f9153493ca6dda343d461c5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9758637e30e4089b394ed6ea5c2cf3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:39.909574 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-92d857a8-25fd-4f3e-a6d7-4ad0d1f28621 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] 10.222.0.17 "GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf" status: 200 len: 1315 microversion: 2.1 time: 0.213221 Sep 30 19:29:39.910152 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 35/98] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:39 2022] GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:29:40.238966 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-5b3b445e-8002-4c8c-acc0-772cce419bb5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:40.239612 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-5b3b445e-8002-4c8c-acc0-772cce419bb5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:40.245540 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5b3b445e-8002-4c8c-acc0-772cce419bb5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:40.246030 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5b3b445e-8002-4c8c-acc0-772cce419bb5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:40.246529 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5b3b445e-8002-4c8c-acc0-772cce419bb5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:40.247244 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5b3b445e-8002-4c8c-acc0-772cce419bb5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:40.247790 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5b3b445e-8002-4c8c-acc0-772cce419bb5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:40.248223 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5b3b445e-8002-4c8c-acc0-772cce419bb5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:40.326491 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-5b3b445e-8002-4c8c-acc0-772cce419bb5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:40.335802 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-5b3b445e-8002-4c8c-acc0-772cce419bb5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1280 microversion: 2.1 time: 0.100639 Sep 30 19:29:40.336392 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 64/99] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:40 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1280 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:29:40.494537 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-57a520f7-da60-4590-82b6-51cc89a32009 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:40.495160 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-57a520f7-da60-4590-82b6-51cc89a32009 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:40.501274 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-57a520f7-da60-4590-82b6-51cc89a32009 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:40.501766 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-57a520f7-da60-4590-82b6-51cc89a32009 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:40.502213 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-57a520f7-da60-4590-82b6-51cc89a32009 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:40.502910 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-57a520f7-da60-4590-82b6-51cc89a32009 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:40.503558 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-57a520f7-da60-4590-82b6-51cc89a32009 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:40.504538 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-57a520f7-da60-4590-82b6-51cc89a32009 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:40.565765 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-57a520f7-da60-4590-82b6-51cc89a32009 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:40.574023 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-57a520f7-da60-4590-82b6-51cc89a32009 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1241 microversion: 2.1 time: 0.083317 Sep 30 19:29:40.574803 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 36/100] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:40 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1241 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:40.698157 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-63f38c83-20ff-4189-bad3-cb348b8c0625 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:40.698772 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-63f38c83-20ff-4189-bad3-cb348b8c0625 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:40.704701 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-63f38c83-20ff-4189-bad3-cb348b8c0625 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:40.705231 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-63f38c83-20ff-4189-bad3-cb348b8c0625 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:40.705609 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-63f38c83-20ff-4189-bad3-cb348b8c0625 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:40.706290 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-63f38c83-20ff-4189-bad3-cb348b8c0625 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:40.706988 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-63f38c83-20ff-4189-bad3-cb348b8c0625 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:40.707906 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-63f38c83-20ff-4189-bad3-cb348b8c0625 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:40.767285 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-63f38c83-20ff-4189-bad3-cb348b8c0625 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:40.775498 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-63f38c83-20ff-4189-bad3-cb348b8c0625 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d" status: 200 len: 1301 microversion: 2.1 time: 0.081216 Sep 30 19:29:40.776067 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 65/101] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:40 2022] GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d => generated 1301 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:40.814966 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-d62a45b0-1e63-42e5-8ee1-3117eb097749 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:40.815581 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-d62a45b0-1e63-42e5-8ee1-3117eb097749 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:40.821534 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d62a45b0-1e63-42e5-8ee1-3117eb097749 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:40.822065 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d62a45b0-1e63-42e5-8ee1-3117eb097749 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:40.822449 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d62a45b0-1e63-42e5-8ee1-3117eb097749 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:40.823143 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d62a45b0-1e63-42e5-8ee1-3117eb097749 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:40.823602 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d62a45b0-1e63-42e5-8ee1-3117eb097749 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:40.824029 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d62a45b0-1e63-42e5-8ee1-3117eb097749 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:40.884657 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-d62a45b0-1e63-42e5-8ee1-3117eb097749 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:40.892908 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-d62a45b0-1e63-42e5-8ee1-3117eb097749 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:40.894341 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-d62a45b0-1e63-42e5-8ee1-3117eb097749 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:40.895959 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-d62a45b0-1e63-42e5-8ee1-3117eb097749 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1284 microversion: 2.20 time: 0.084914 Sep 30 19:29:40.905407 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 37/102] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:29:40 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1284 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:29:40.932840 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-253b1629-99b7-4995-9041-98a31b416ef6 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:40.933454 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-253b1629-99b7-4995-9041-98a31b416ef6 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] [instance: 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:40.939532 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-253b1629-99b7-4995-9041-98a31b416ef6 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:40.940080 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-253b1629-99b7-4995-9041-98a31b416ef6 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:40.940554 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-253b1629-99b7-4995-9041-98a31b416ef6 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:40.941251 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-253b1629-99b7-4995-9041-98a31b416ef6 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:40.941903 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-253b1629-99b7-4995-9041-98a31b416ef6 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:40.942296 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-253b1629-99b7-4995-9041-98a31b416ef6 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:41.075901 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-253b1629-99b7-4995-9041-98a31b416ef6 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bb718f9153493ca6dda343d461c5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9758637e30e4089b394ed6ea5c2cf3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:41.085124 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-253b1629-99b7-4995-9041-98a31b416ef6 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] 10.222.0.17 "GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf" status: 200 len: 1315 microversion: 2.1 time: 0.156162 Sep 30 19:29:41.085701 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 66/103] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:40 2022] GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:41.358786 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-943572ee-5874-49aa-a69a-104f7d648a81 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:41.359397 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-943572ee-5874-49aa-a69a-104f7d648a81 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:41.366033 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-943572ee-5874-49aa-a69a-104f7d648a81 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:41.366523 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-943572ee-5874-49aa-a69a-104f7d648a81 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:41.366961 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-943572ee-5874-49aa-a69a-104f7d648a81 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:41.367656 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-943572ee-5874-49aa-a69a-104f7d648a81 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:41.368112 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-943572ee-5874-49aa-a69a-104f7d648a81 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:41.368568 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-943572ee-5874-49aa-a69a-104f7d648a81 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:41.430448 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-943572ee-5874-49aa-a69a-104f7d648a81 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:41.438192 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-943572ee-5874-49aa-a69a-104f7d648a81 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1280 microversion: 2.1 time: 0.083163 Sep 30 19:29:41.438762 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 38/104] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:41 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1280 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:41.596699 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-70c469ca-afa2-4f02-8caf-7f6b5a858024 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:41.597342 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-70c469ca-afa2-4f02-8caf-7f6b5a858024 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:41.603968 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-70c469ca-afa2-4f02-8caf-7f6b5a858024 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:41.604571 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-70c469ca-afa2-4f02-8caf-7f6b5a858024 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:41.605029 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-70c469ca-afa2-4f02-8caf-7f6b5a858024 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:41.605727 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-70c469ca-afa2-4f02-8caf-7f6b5a858024 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:41.606210 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-70c469ca-afa2-4f02-8caf-7f6b5a858024 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:41.606641 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-70c469ca-afa2-4f02-8caf-7f6b5a858024 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:41.668818 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-70c469ca-afa2-4f02-8caf-7f6b5a858024 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:41.676435 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-70c469ca-afa2-4f02-8caf-7f6b5a858024 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1241 microversion: 2.1 time: 0.083635 Sep 30 19:29:41.677196 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 67/105] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:41 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1241 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:41.799175 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-8480d875-82ee-4317-b82d-3ade550e6db9 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:41.799886 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-8480d875-82ee-4317-b82d-3ade550e6db9 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:41.805056 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell0:SELECT=8 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:41.807025 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8480d875-82ee-4317-b82d-3ade550e6db9 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:41.807471 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8480d875-82ee-4317-b82d-3ade550e6db9 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:41.808101 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8480d875-82ee-4317-b82d-3ade550e6db9 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:41.808887 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8480d875-82ee-4317-b82d-3ade550e6db9 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:41.809337 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8480d875-82ee-4317-b82d-3ade550e6db9 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:41.809784 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8480d875-82ee-4317-b82d-3ade550e6db9 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:41.870765 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-8480d875-82ee-4317-b82d-3ade550e6db9 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:41.879488 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-8480d875-82ee-4317-b82d-3ade550e6db9 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d" status: 200 len: 1301 microversion: 2.1 time: 0.083965 Sep 30 19:29:41.880623 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 39/106] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:41 2022] GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d => generated 1301 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:41.921524 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-84b760f4-dd9c-4500-acfd-81485feed6fc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:41.922265 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-84b760f4-dd9c-4500-acfd-81485feed6fc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:41.928015 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-84b760f4-dd9c-4500-acfd-81485feed6fc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:41.928530 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-84b760f4-dd9c-4500-acfd-81485feed6fc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:41.928964 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-84b760f4-dd9c-4500-acfd-81485feed6fc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:41.929650 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-84b760f4-dd9c-4500-acfd-81485feed6fc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:41.930095 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-84b760f4-dd9c-4500-acfd-81485feed6fc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:41.930548 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-84b760f4-dd9c-4500-acfd-81485feed6fc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:41.991487 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-84b760f4-dd9c-4500-acfd-81485feed6fc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:42.000483 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-84b760f4-dd9c-4500-acfd-81485feed6fc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:42.001926 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-84b760f4-dd9c-4500-acfd-81485feed6fc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:42.003031 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-84b760f4-dd9c-4500-acfd-81485feed6fc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1284 microversion: 2.20 time: 0.085416 Sep 30 19:29:42.010553 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 68/107] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:29:41 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1284 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:29:42.108201 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-ed10b288-0637-4772-b7d4-0fd5406ec57a tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:42.108828 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-ed10b288-0637-4772-b7d4-0fd5406ec57a tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] [instance: 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:42.114841 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ed10b288-0637-4772-b7d4-0fd5406ec57a tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:42.115329 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ed10b288-0637-4772-b7d4-0fd5406ec57a tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:42.115762 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ed10b288-0637-4772-b7d4-0fd5406ec57a tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:42.116505 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ed10b288-0637-4772-b7d4-0fd5406ec57a tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:42.116957 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ed10b288-0637-4772-b7d4-0fd5406ec57a tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:42.117378 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ed10b288-0637-4772-b7d4-0fd5406ec57a tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:42.248759 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-ed10b288-0637-4772-b7d4-0fd5406ec57a tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bb718f9153493ca6dda343d461c5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9758637e30e4089b394ed6ea5c2cf3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:42.256227 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-ed10b288-0637-4772-b7d4-0fd5406ec57a tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] 10.222.0.17 "GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf" status: 200 len: 1315 microversion: 2.1 time: 0.151847 Sep 30 19:29:42.257130 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 40/108] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:42 2022] GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:42.461077 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-bdc09e23-5116-4f2b-af09-ce1d5e572525 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:42.461695 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-bdc09e23-5116-4f2b-af09-ce1d5e572525 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:42.468118 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bdc09e23-5116-4f2b-af09-ce1d5e572525 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:42.468671 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bdc09e23-5116-4f2b-af09-ce1d5e572525 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:42.469114 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bdc09e23-5116-4f2b-af09-ce1d5e572525 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:42.469833 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bdc09e23-5116-4f2b-af09-ce1d5e572525 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:42.470541 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bdc09e23-5116-4f2b-af09-ce1d5e572525 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:42.471019 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bdc09e23-5116-4f2b-af09-ce1d5e572525 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:42.536539 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-bdc09e23-5116-4f2b-af09-ce1d5e572525 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:42.545295 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=34 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:42.547896 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-bdc09e23-5116-4f2b-af09-ce1d5e572525 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1280 microversion: 2.1 time: 0.091160 Sep 30 19:29:42.548656 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 69/109] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:42 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1280 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:42.699421 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-f6b01302-f6bf-41f0-a0c2-415fe3ddc911 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:42.700036 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-f6b01302-f6bf-41f0-a0c2-415fe3ddc911 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:42.701973 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell0:SELECT=28 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:42.707242 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f6b01302-f6bf-41f0-a0c2-415fe3ddc911 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:42.707737 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f6b01302-f6bf-41f0-a0c2-415fe3ddc911 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:42.708182 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f6b01302-f6bf-41f0-a0c2-415fe3ddc911 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:42.708922 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f6b01302-f6bf-41f0-a0c2-415fe3ddc911 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:42.709373 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f6b01302-f6bf-41f0-a0c2-415fe3ddc911 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:42.709810 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f6b01302-f6bf-41f0-a0c2-415fe3ddc911 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:42.773913 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-f6b01302-f6bf-41f0-a0c2-415fe3ddc911 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:42.782192 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-f6b01302-f6bf-41f0-a0c2-415fe3ddc911 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1241 microversion: 2.1 time: 0.086626 Sep 30 19:29:42.782960 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 41/110] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:42 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1241 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:42.902939 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-0a5f6b30-58e7-48ba-8420-1a2ce9e738fc tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:42.903657 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-0a5f6b30-58e7-48ba-8420-1a2ce9e738fc tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:42.911038 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0a5f6b30-58e7-48ba-8420-1a2ce9e738fc tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:42.911744 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0a5f6b30-58e7-48ba-8420-1a2ce9e738fc tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:42.912479 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0a5f6b30-58e7-48ba-8420-1a2ce9e738fc tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:42.913375 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0a5f6b30-58e7-48ba-8420-1a2ce9e738fc tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:42.914016 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0a5f6b30-58e7-48ba-8420-1a2ce9e738fc tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:42.914620 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0a5f6b30-58e7-48ba-8420-1a2ce9e738fc tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:42.952284 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=6 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:43.029453 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-0a5f6b30-58e7-48ba-8420-1a2ce9e738fc tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:43.032051 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-4b38619c-ff78-449c-b31e-0f0fbb892d8b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:43.032798 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-4b38619c-ff78-449c-b31e-0f0fbb892d8b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:43.040659 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4b38619c-ff78-449c-b31e-0f0fbb892d8b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:43.042037 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-0a5f6b30-58e7-48ba-8420-1a2ce9e738fc tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d" status: 200 len: 1301 microversion: 2.1 time: 0.143010 Sep 30 19:29:43.043648 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 70/111] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:42 2022] GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d => generated 1301 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:43.047210 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4b38619c-ff78-449c-b31e-0f0fbb892d8b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:43.049397 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4b38619c-ff78-449c-b31e-0f0fbb892d8b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:43.052504 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4b38619c-ff78-449c-b31e-0f0fbb892d8b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:43.053171 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4b38619c-ff78-449c-b31e-0f0fbb892d8b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:43.054448 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4b38619c-ff78-449c-b31e-0f0fbb892d8b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:43.141666 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-4b38619c-ff78-449c-b31e-0f0fbb892d8b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:43.153228 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-4b38619c-ff78-449c-b31e-0f0fbb892d8b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:43.154676 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-4b38619c-ff78-449c-b31e-0f0fbb892d8b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:43.156031 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-4b38619c-ff78-449c-b31e-0f0fbb892d8b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1284 microversion: 2.20 time: 0.130588 Sep 30 19:29:43.156896 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 42/112] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:29:43 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1284 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:29:43.291008 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-03d63b6d-cff0-49f2-89db-5144f4d796f0 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:43.291008 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-03d63b6d-cff0-49f2-89db-5144f4d796f0 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] [instance: 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:43.295825 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-03d63b6d-cff0-49f2-89db-5144f4d796f0 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:43.295825 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-03d63b6d-cff0-49f2-89db-5144f4d796f0 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:43.295825 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-03d63b6d-cff0-49f2-89db-5144f4d796f0 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:43.295825 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-03d63b6d-cff0-49f2-89db-5144f4d796f0 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:43.296215 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-03d63b6d-cff0-49f2-89db-5144f4d796f0 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:43.297189 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-03d63b6d-cff0-49f2-89db-5144f4d796f0 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:43.573904 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-b9811e8e-53c7-469d-87f5-21675a105962 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:43.574620 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-b9811e8e-53c7-469d-87f5-21675a105962 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:43.588752 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b9811e8e-53c7-469d-87f5-21675a105962 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:43.589420 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b9811e8e-53c7-469d-87f5-21675a105962 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:43.592817 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b9811e8e-53c7-469d-87f5-21675a105962 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:43.593563 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b9811e8e-53c7-469d-87f5-21675a105962 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:43.594024 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b9811e8e-53c7-469d-87f5-21675a105962 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:43.594453 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b9811e8e-53c7-469d-87f5-21675a105962 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:43.689767 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-03d63b6d-cff0-49f2-89db-5144f4d796f0 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bb718f9153493ca6dda343d461c5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9758637e30e4089b394ed6ea5c2cf3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:43.700070 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-03d63b6d-cff0-49f2-89db-5144f4d796f0 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] 10.222.0.17 "GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf" status: 200 len: 1315 microversion: 2.1 time: 0.424583 Sep 30 19:29:43.703400 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 71/113] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:43 2022] GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf => generated 1315 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:43.808027 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-d93bdb38-ed56-4349-85cc-807e9124d5a1 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:43.808965 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-d93bdb38-ed56-4349-85cc-807e9124d5a1 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:43.815782 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d93bdb38-ed56-4349-85cc-807e9124d5a1 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:43.816740 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d93bdb38-ed56-4349-85cc-807e9124d5a1 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:43.817467 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d93bdb38-ed56-4349-85cc-807e9124d5a1 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:43.818468 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d93bdb38-ed56-4349-85cc-807e9124d5a1 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:43.819130 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d93bdb38-ed56-4349-85cc-807e9124d5a1 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:43.819859 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d93bdb38-ed56-4349-85cc-807e9124d5a1 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:44.000521 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-d93bdb38-ed56-4349-85cc-807e9124d5a1 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:44.003214 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-b9811e8e-53c7-469d-87f5-21675a105962 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:44.011832 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-b9811e8e-53c7-469d-87f5-21675a105962 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1280 microversion: 2.1 time: 0.443813 Sep 30 19:29:44.016994 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 43/114] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:43 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1280 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:44.037067 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-d93bdb38-ed56-4349-85cc-807e9124d5a1 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1289 microversion: 2.1 time: 0.230019 Sep 30 19:29:44.040666 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 72/115] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:43 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1289 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:29:44.071949 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-317c086b-5ea4-42c5-ab6c-669ac0b1a9db tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:44.072839 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-317c086b-5ea4-42c5-ab6c-669ac0b1a9db tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:44.088508 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-317c086b-5ea4-42c5-ab6c-669ac0b1a9db tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:44.089132 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-317c086b-5ea4-42c5-ab6c-669ac0b1a9db tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:44.089678 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-317c086b-5ea4-42c5-ab6c-669ac0b1a9db tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:44.090759 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-317c086b-5ea4-42c5-ab6c-669ac0b1a9db tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:44.091433 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-317c086b-5ea4-42c5-ab6c-669ac0b1a9db tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:44.093297 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-317c086b-5ea4-42c5-ab6c-669ac0b1a9db tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:44.183431 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-cd2def49-d559-4f2e-b2d1-16d920536e57 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:44.184084 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-cd2def49-d559-4f2e-b2d1-16d920536e57 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:44.191105 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cd2def49-d559-4f2e-b2d1-16d920536e57 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:44.192142 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cd2def49-d559-4f2e-b2d1-16d920536e57 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:44.192617 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cd2def49-d559-4f2e-b2d1-16d920536e57 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:44.193330 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cd2def49-d559-4f2e-b2d1-16d920536e57 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:44.193770 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cd2def49-d559-4f2e-b2d1-16d920536e57 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:44.199005 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cd2def49-d559-4f2e-b2d1-16d920536e57 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:44.222624 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-317c086b-5ea4-42c5-ab6c-669ac0b1a9db tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:44.234156 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-317c086b-5ea4-42c5-ab6c-669ac0b1a9db tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d" status: 200 len: 1299 microversion: 2.1 time: 0.167999 Sep 30 19:29:44.235457 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 44/116] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:44 2022] GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d => generated 1299 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:44.450419 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-cd2def49-d559-4f2e-b2d1-16d920536e57 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:44.468504 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-cd2def49-d559-4f2e-b2d1-16d920536e57 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:44.470545 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-cd2def49-d559-4f2e-b2d1-16d920536e57 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:44.480622 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-cd2def49-d559-4f2e-b2d1-16d920536e57 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1276 microversion: 2.20 time: 0.293293 Sep 30 19:29:44.480622 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 73/117] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:29:44 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1276 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:29:44.729153 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-5f29e0c3-a675-4973-9408-9775847e8087 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:44.729814 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-5f29e0c3-a675-4973-9408-9775847e8087 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] [instance: 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:44.737516 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5f29e0c3-a675-4973-9408-9775847e8087 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:44.738001 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5f29e0c3-a675-4973-9408-9775847e8087 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:44.738471 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5f29e0c3-a675-4973-9408-9775847e8087 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:44.739167 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5f29e0c3-a675-4973-9408-9775847e8087 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:44.739621 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5f29e0c3-a675-4973-9408-9775847e8087 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:44.740039 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5f29e0c3-a675-4973-9408-9775847e8087 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:45.095140 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-32e06e3e-6f09-4a41-9364-a1831bea8529 req-12347363-3220-4d14-b995-fe758b472bf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf", "tag": "0898c149-da59-4f69-9cfb-2f5ece95d7bf"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:29:45.103875 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-32e06e3e-6f09-4a41-9364-a1831bea8529 req-12347363-3220-4d14-b995-fe758b472bf8 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:45.104385 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-32e06e3e-6f09-4a41-9364-a1831bea8529 req-12347363-3220-4d14-b995-fe758b472bf8 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:45.104842 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-32e06e3e-6f09-4a41-9364-a1831bea8529 req-12347363-3220-4d14-b995-fe758b472bf8 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:45.118136 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-32e06e3e-6f09-4a41-9364-a1831bea8529 req-12347363-3220-4d14-b995-fe758b472bf8 service nova] Creating event network-changed:0898c149-da59-4f69-9cfb-2f5ece95d7bf for instance 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf on hv-cinder-86001 Sep 30 19:29:45.128446 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-32e06e3e-6f09-4a41-9364-a1831bea8529 req-12347363-3220-4d14-b995-fe758b472bf8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.209491 Sep 30 19:29:45.130593 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 74/118] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 30 19:29:45.138056 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-5e4377cf-0e94-4b5a-bf68-1a3bcb358879 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:45.163640 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-5e4377cf-0e94-4b5a-bf68-1a3bcb358879 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:45.163640 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5e4377cf-0e94-4b5a-bf68-1a3bcb358879 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:45.163640 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5e4377cf-0e94-4b5a-bf68-1a3bcb358879 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:45.163640 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5e4377cf-0e94-4b5a-bf68-1a3bcb358879 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:45.165381 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5e4377cf-0e94-4b5a-bf68-1a3bcb358879 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:45.165381 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5e4377cf-0e94-4b5a-bf68-1a3bcb358879 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:45.165381 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5e4377cf-0e94-4b5a-bf68-1a3bcb358879 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:45.428320 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-5f29e0c3-a675-4973-9408-9775847e8087 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bb718f9153493ca6dda343d461c5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9758637e30e4089b394ed6ea5c2cf3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:45.437688 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-5f29e0c3-a675-4973-9408-9775847e8087 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] 10.222.0.17 "GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf" status: 200 len: 1315 microversion: 2.1 time: 0.712208 Sep 30 19:29:45.438664 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 45/119] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:44 2022] GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf => generated 1315 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:45.448507 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-478c5902-f9c4-49cd-8b7a-ac15f9938d3b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:45.449795 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-478c5902-f9c4-49cd-8b7a-ac15f9938d3b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:45.473498 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-478c5902-f9c4-49cd-8b7a-ac15f9938d3b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:45.474021 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-478c5902-f9c4-49cd-8b7a-ac15f9938d3b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:45.475717 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-478c5902-f9c4-49cd-8b7a-ac15f9938d3b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:45.477698 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-478c5902-f9c4-49cd-8b7a-ac15f9938d3b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:45.478579 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-478c5902-f9c4-49cd-8b7a-ac15f9938d3b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:45.479070 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-478c5902-f9c4-49cd-8b7a-ac15f9938d3b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:45.622917 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-478c5902-f9c4-49cd-8b7a-ac15f9938d3b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:45.626415 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell1:SELECT=100 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:45.638385 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-478c5902-f9c4-49cd-8b7a-ac15f9938d3b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1295 microversion: 2.1 time: 0.198283 Sep 30 19:29:45.638994 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 46/120] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:45 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1295 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:45.646207 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-45b91dcc-5dfe-4e46-a9af-7868b2d7dbc7 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:45.646819 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-45b91dcc-5dfe-4e46-a9af-7868b2d7dbc7 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:45.653936 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-45b91dcc-5dfe-4e46-a9af-7868b2d7dbc7 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:45.654463 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-45b91dcc-5dfe-4e46-a9af-7868b2d7dbc7 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:45.654911 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-45b91dcc-5dfe-4e46-a9af-7868b2d7dbc7 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:45.655609 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-45b91dcc-5dfe-4e46-a9af-7868b2d7dbc7 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:45.656223 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-45b91dcc-5dfe-4e46-a9af-7868b2d7dbc7 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:45.656703 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-45b91dcc-5dfe-4e46-a9af-7868b2d7dbc7 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:45.991150 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-45b91dcc-5dfe-4e46-a9af-7868b2d7dbc7 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:45.999418 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-45b91dcc-5dfe-4e46-a9af-7868b2d7dbc7 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d" status: 200 len: 1366 microversion: 2.1 time: 0.358244 Sep 30 19:29:46.014055 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 47/121] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:45 2022] GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d => generated 1366 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:46.023200 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-9bf026b9-fcd9-412f-ae25-65587acee625 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:46.027750 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-9bf026b9-fcd9-412f-ae25-65587acee625 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:46.039241 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9bf026b9-fcd9-412f-ae25-65587acee625 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:46.040068 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9bf026b9-fcd9-412f-ae25-65587acee625 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:46.040746 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9bf026b9-fcd9-412f-ae25-65587acee625 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:46.041655 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9bf026b9-fcd9-412f-ae25-65587acee625 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:46.042309 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9bf026b9-fcd9-412f-ae25-65587acee625 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:46.042952 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9bf026b9-fcd9-412f-ae25-65587acee625 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:46.056386 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-5e4377cf-0e94-4b5a-bf68-1a3bcb358879 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:46.065665 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-5e4377cf-0e94-4b5a-bf68-1a3bcb358879 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1322 microversion: 2.1 time: 0.932846 Sep 30 19:29:46.082569 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 75/122] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:45 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1322 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:46.180334 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-9bf026b9-fcd9-412f-ae25-65587acee625 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:46.190780 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-9bf026b9-fcd9-412f-ae25-65587acee625 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:46.192855 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-9bf026b9-fcd9-412f-ae25-65587acee625 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:46.194472 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-9bf026b9-fcd9-412f-ae25-65587acee625 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1332 microversion: 2.20 time: 0.179062 Sep 30 19:29:46.195422 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 48/123] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:29:46 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1332 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:29:46.469046 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-25c5cfc2-3a63-4906-9195-242c07c82db0 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:46.471200 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-25c5cfc2-3a63-4906-9195-242c07c82db0 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] [instance: 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:46.480318 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-25c5cfc2-3a63-4906-9195-242c07c82db0 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:46.481149 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-25c5cfc2-3a63-4906-9195-242c07c82db0 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:46.481886 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-25c5cfc2-3a63-4906-9195-242c07c82db0 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:46.484087 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-25c5cfc2-3a63-4906-9195-242c07c82db0 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:46.488786 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-25c5cfc2-3a63-4906-9195-242c07c82db0 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:46.489399 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-25c5cfc2-3a63-4906-9195-242c07c82db0 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:46.665984 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-078b0456-e49f-4dca-96b8-379027a981ed tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:46.668121 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-078b0456-e49f-4dca-96b8-379027a981ed tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:46.674979 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-078b0456-e49f-4dca-96b8-379027a981ed tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:46.676403 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-078b0456-e49f-4dca-96b8-379027a981ed tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:46.677115 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-078b0456-e49f-4dca-96b8-379027a981ed tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:46.678019 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-078b0456-e49f-4dca-96b8-379027a981ed tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:46.678669 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-078b0456-e49f-4dca-96b8-379027a981ed tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:46.679288 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-078b0456-e49f-4dca-96b8-379027a981ed tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:46.819005 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-078b0456-e49f-4dca-96b8-379027a981ed tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:46.829144 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-078b0456-e49f-4dca-96b8-379027a981ed tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1295 microversion: 2.1 time: 0.169803 Sep 30 19:29:46.829662 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 49/124] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:46 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1295 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:29:46.885070 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-25c5cfc2-3a63-4906-9195-242c07c82db0 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bb718f9153493ca6dda343d461c5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9758637e30e4089b394ed6ea5c2cf3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:46.905945 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-25c5cfc2-3a63-4906-9195-242c07c82db0 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] 10.222.0.17 "GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf" status: 200 len: 1315 microversion: 2.1 time: 0.441981 Sep 30 19:29:46.906729 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 76/125] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:46 2022] GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf => generated 1315 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:47.027024 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-d70d322c-533a-416f-b722-0699dc721b19 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:47.027679 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-d70d322c-533a-416f-b722-0699dc721b19 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:47.034882 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d70d322c-533a-416f-b722-0699dc721b19 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:47.036493 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d70d322c-533a-416f-b722-0699dc721b19 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:47.037129 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d70d322c-533a-416f-b722-0699dc721b19 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:47.038098 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d70d322c-533a-416f-b722-0699dc721b19 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:47.038743 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d70d322c-533a-416f-b722-0699dc721b19 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:47.039369 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d70d322c-533a-416f-b722-0699dc721b19 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:47.089614 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-2185512d-d62b-4ea3-9754-be2f4b9c72fb tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:47.090282 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-2185512d-d62b-4ea3-9754-be2f4b9c72fb tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:47.097014 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2185512d-d62b-4ea3-9754-be2f4b9c72fb tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:47.097742 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2185512d-d62b-4ea3-9754-be2f4b9c72fb tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:47.098714 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2185512d-d62b-4ea3-9754-be2f4b9c72fb tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:47.099665 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2185512d-d62b-4ea3-9754-be2f4b9c72fb tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:47.100289 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2185512d-d62b-4ea3-9754-be2f4b9c72fb tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:47.100874 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2185512d-d62b-4ea3-9754-be2f4b9c72fb tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:47.122228 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=100 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:47.242409 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-d70d322c-533a-416f-b722-0699dc721b19 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:47.250888 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-d70d322c-533a-416f-b722-0699dc721b19 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d" status: 200 len: 1366 microversion: 2.1 time: 0.227674 Sep 30 19:29:47.251787 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 50/126] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:47 2022] GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:47.268057 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-12f6b990-894e-4ca3-b141-7373591144dd tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:47.268782 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-12f6b990-894e-4ca3-b141-7373591144dd tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:47.277244 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-12f6b990-894e-4ca3-b141-7373591144dd tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:47.278007 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-12f6b990-894e-4ca3-b141-7373591144dd tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:47.278496 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-12f6b990-894e-4ca3-b141-7373591144dd tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:47.279584 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-12f6b990-894e-4ca3-b141-7373591144dd tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:47.280036 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-12f6b990-894e-4ca3-b141-7373591144dd tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:47.280662 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-12f6b990-894e-4ca3-b141-7373591144dd tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:47.381035 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-12f6b990-894e-4ca3-b141-7373591144dd tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:47.398145 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-12f6b990-894e-4ca3-b141-7373591144dd tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:47.399898 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-12f6b990-894e-4ca3-b141-7373591144dd tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:47.401074 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-12f6b990-894e-4ca3-b141-7373591144dd tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1338 microversion: 2.20 time: 0.148105 Sep 30 19:29:47.421164 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 51/127] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:29:47 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1338 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:29:47.424249 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [req-dab5a03a-7051-4abc-8890-1326df3a598a req-342817e8-a26a-4853-b001-dbd445d06590 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31", "tag": "55d19521-9bc7-4a83-a9b2-6c9a8c1ae53f"}]} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:29:47.446152 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-dab5a03a-7051-4abc-8890-1326df3a598a req-342817e8-a26a-4853-b001-dbd445d06590 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:47.446699 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-dab5a03a-7051-4abc-8890-1326df3a598a req-342817e8-a26a-4853-b001-dbd445d06590 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:47.447193 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-dab5a03a-7051-4abc-8890-1326df3a598a req-342817e8-a26a-4853-b001-dbd445d06590 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:47.448057 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-2185512d-d62b-4ea3-9754-be2f4b9c72fb tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:47.456257 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-2185512d-d62b-4ea3-9754-be2f4b9c72fb tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1322 microversion: 2.1 time: 0.370417 Sep 30 19:29:47.457614 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 77/128] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:47 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1322 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:29:47.462427 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-9a0a1a49-285e-4e78-bd7b-685ea5d43ea5 req-fd0b0255-500d-4dc1-8cc1-60e11bc20d0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a84ee4e3-e6e4-4574-810f-8e5e796b4c4d", "tag": "703c0c85-a09a-452a-a548-87d9d670da7d"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:29:47.467825 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.compute.server_external_events [req-dab5a03a-7051-4abc-8890-1326df3a598a req-342817e8-a26a-4853-b001-dbd445d06590 service nova] Creating event network-changed:55d19521-9bc7-4a83-a9b2-6c9a8c1ae53f for instance 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 on hv-cinder-86001 Sep 30 19:29:47.468801 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-dab5a03a-7051-4abc-8890-1326df3a598a req-342817e8-a26a-4853-b001-dbd445d06590 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120649) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 30 19:29:47.468945 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-dab5a03a-7051-4abc-8890-1326df3a598a req-342817e8-a26a-4853-b001-dbd445d06590 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120649) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 30 19:29:47.470037 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e8755c19-d420-4f6d-a1ce-0605f3c493cc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:47.470743 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e8755c19-d420-4f6d-a1ce-0605f3c493cc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:47.471274 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e8755c19-d420-4f6d-a1ce-0605f3c493cc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:47.472077 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e8755c19-d420-4f6d-a1ce-0605f3c493cc None None] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:47.473237 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e8755c19-d420-4f6d-a1ce-0605f3c493cc None None] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:47.473817 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e8755c19-d420-4f6d-a1ce-0605f3c493cc None None] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:47.474329 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-9a0a1a49-285e-4e78-bd7b-685ea5d43ea5 req-fd0b0255-500d-4dc1-8cc1-60e11bc20d0e service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:47.475306 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-9a0a1a49-285e-4e78-bd7b-685ea5d43ea5 req-fd0b0255-500d-4dc1-8cc1-60e11bc20d0e service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:47.475890 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-9a0a1a49-285e-4e78-bd7b-685ea5d43ea5 req-fd0b0255-500d-4dc1-8cc1-60e11bc20d0e service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:47.484530 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.compute.rpcapi [None req-e8755c19-d420-4f6d-a1ce-0605f3c493cc None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 30 19:29:47.485550 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e8755c19-d420-4f6d-a1ce-0605f3c493cc None None] Releasing lock "compute-rpcapi-router" {{(pid=120649) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 30 19:29:47.487402 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-9a0a1a49-285e-4e78-bd7b-685ea5d43ea5 req-fd0b0255-500d-4dc1-8cc1-60e11bc20d0e service nova] Creating event network-changed:703c0c85-a09a-452a-a548-87d9d670da7d for instance a84ee4e3-e6e4-4574-810f-8e5e796b4c4d on hv-cinder-86001 Sep 30 19:29:47.492908 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-9a0a1a49-285e-4e78-bd7b-685ea5d43ea5 req-fd0b0255-500d-4dc1-8cc1-60e11bc20d0e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033922 Sep 30 19:29:47.497735 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 78/129] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:29:47.503914 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-e8755c19-d420-4f6d-a1ce-0605f3c493cc None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084633 Sep 30 19:29:47.504794 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 52/130] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:29:47.857176 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-2c54e0fc-8316-4026-a341-f7397493a519 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:47.857958 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-2c54e0fc-8316-4026-a341-f7397493a519 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:47.864561 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2c54e0fc-8316-4026-a341-f7397493a519 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:47.865045 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2c54e0fc-8316-4026-a341-f7397493a519 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:47.865482 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2c54e0fc-8316-4026-a341-f7397493a519 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:47.866168 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2c54e0fc-8316-4026-a341-f7397493a519 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:47.866724 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2c54e0fc-8316-4026-a341-f7397493a519 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:47.867196 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2c54e0fc-8316-4026-a341-f7397493a519 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:47.931438 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-4b6c6e03-d444-4268-a8bc-03724fca66c0 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:47.933670 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-4b6c6e03-d444-4268-a8bc-03724fca66c0 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] [instance: 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:47.941034 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4b6c6e03-d444-4268-a8bc-03724fca66c0 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:47.950414 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4b6c6e03-d444-4268-a8bc-03724fca66c0 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:47.951292 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4b6c6e03-d444-4268-a8bc-03724fca66c0 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:47.952139 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4b6c6e03-d444-4268-a8bc-03724fca66c0 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:47.952856 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4b6c6e03-d444-4268-a8bc-03724fca66c0 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:47.953375 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4b6c6e03-d444-4268-a8bc-03724fca66c0 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:48.053550 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-2c54e0fc-8316-4026-a341-f7397493a519 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:48.068060 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-2c54e0fc-8316-4026-a341-f7397493a519 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1363 microversion: 2.1 time: 0.214892 Sep 30 19:29:48.084575 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 79/131] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:47 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1363 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:48.140263 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-4b6c6e03-d444-4268-a8bc-03724fca66c0 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bb718f9153493ca6dda343d461c5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9758637e30e4089b394ed6ea5c2cf3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:48.149799 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-4b6c6e03-d444-4268-a8bc-03724fca66c0 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] 10.222.0.17 "GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf" status: 200 len: 1315 microversion: 2.1 time: 0.223996 Sep 30 19:29:48.150846 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 53/132] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:47 2022] GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:48.283491 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-2705d9ab-0537-4fed-81de-e46e02d898e5 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:48.284453 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-2705d9ab-0537-4fed-81de-e46e02d898e5 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:48.300508 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2705d9ab-0537-4fed-81de-e46e02d898e5 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:48.301219 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2705d9ab-0537-4fed-81de-e46e02d898e5 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:48.301921 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2705d9ab-0537-4fed-81de-e46e02d898e5 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:48.302784 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2705d9ab-0537-4fed-81de-e46e02d898e5 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:48.303393 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2705d9ab-0537-4fed-81de-e46e02d898e5 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:48.303823 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2705d9ab-0537-4fed-81de-e46e02d898e5 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:48.427531 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-d1590c9f-d1fe-415c-b5e8-c2285de77400 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:48.428469 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-d1590c9f-d1fe-415c-b5e8-c2285de77400 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:48.435269 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d1590c9f-d1fe-415c-b5e8-c2285de77400 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:48.435751 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d1590c9f-d1fe-415c-b5e8-c2285de77400 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:48.436182 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d1590c9f-d1fe-415c-b5e8-c2285de77400 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:48.436900 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d1590c9f-d1fe-415c-b5e8-c2285de77400 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:48.437347 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d1590c9f-d1fe-415c-b5e8-c2285de77400 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:48.437770 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d1590c9f-d1fe-415c-b5e8-c2285de77400 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:48.507286 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-d1590c9f-d1fe-415c-b5e8-c2285de77400 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:48.515521 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-2705d9ab-0537-4fed-81de-e46e02d898e5 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:48.520346 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-d1590c9f-d1fe-415c-b5e8-c2285de77400 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:48.521940 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-d1590c9f-d1fe-415c-b5e8-c2285de77400 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:48.523161 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-d1590c9f-d1fe-415c-b5e8-c2285de77400 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1338 microversion: 2.20 time: 0.099548 Sep 30 19:29:48.523987 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-2705d9ab-0537-4fed-81de-e46e02d898e5 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d" status: 200 len: 1366 microversion: 2.1 time: 0.249903 Sep 30 19:29:48.524115 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 54/133] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:29:48 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1338 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:29:48.525041 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 80/134] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:48 2022] GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:48.528734 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-2adf0e44-22f8-4dcc-90e5-f620b7f4b322 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:48.529335 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-2adf0e44-22f8-4dcc-90e5-f620b7f4b322 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:48.535516 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2adf0e44-22f8-4dcc-90e5-f620b7f4b322 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:48.535994 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2adf0e44-22f8-4dcc-90e5-f620b7f4b322 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:48.536460 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2adf0e44-22f8-4dcc-90e5-f620b7f4b322 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:48.537149 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2adf0e44-22f8-4dcc-90e5-f620b7f4b322 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:48.537606 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2adf0e44-22f8-4dcc-90e5-f620b7f4b322 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:48.538030 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2adf0e44-22f8-4dcc-90e5-f620b7f4b322 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:48.717004 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-2adf0e44-22f8-4dcc-90e5-f620b7f4b322 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:48.725563 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-2adf0e44-22f8-4dcc-90e5-f620b7f4b322 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1322 microversion: 2.1 time: 0.200360 Sep 30 19:29:48.726378 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 55/135] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:48 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:49.092607 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-3e3ceacf-f851-40e1-b001-ff3a2872f15f tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:49.093185 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-3e3ceacf-f851-40e1-b001-ff3a2872f15f tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:49.099561 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3e3ceacf-f851-40e1-b001-ff3a2872f15f tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:49.100047 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3e3ceacf-f851-40e1-b001-ff3a2872f15f tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:49.100511 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3e3ceacf-f851-40e1-b001-ff3a2872f15f tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:49.101201 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3e3ceacf-f851-40e1-b001-ff3a2872f15f tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:49.101670 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3e3ceacf-f851-40e1-b001-ff3a2872f15f tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:49.102080 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3e3ceacf-f851-40e1-b001-ff3a2872f15f tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:49.173558 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-49b30758-2769-4044-8c06-ea755901f454 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:49.174171 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-49b30758-2769-4044-8c06-ea755901f454 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] [instance: 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:49.180797 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-49b30758-2769-4044-8c06-ea755901f454 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:49.181283 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-49b30758-2769-4044-8c06-ea755901f454 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:49.181723 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-49b30758-2769-4044-8c06-ea755901f454 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:49.182424 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-49b30758-2769-4044-8c06-ea755901f454 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:49.182879 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-49b30758-2769-4044-8c06-ea755901f454 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:49.183305 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-49b30758-2769-4044-8c06-ea755901f454 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:49.274847 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-3e3ceacf-f851-40e1-b001-ff3a2872f15f tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:49.282515 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-3e3ceacf-f851-40e1-b001-ff3a2872f15f tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1363 microversion: 2.1 time: 0.193886 Sep 30 19:29:49.283093 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 81/136] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:49 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1363 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:29:49.390247 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-49b30758-2769-4044-8c06-ea755901f454 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bb718f9153493ca6dda343d461c5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9758637e30e4089b394ed6ea5c2cf3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:49.401412 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-49b30758-2769-4044-8c06-ea755901f454 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] 10.222.0.17 "GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf" status: 200 len: 1315 microversion: 2.1 time: 0.232035 Sep 30 19:29:49.402139 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 56/137] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:49 2022] GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:29:49.548863 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-2928e093-a6b7-48de-973a-46aebca0a588 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:49.554125 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-4f8fd49e-6947-489d-b277-b7dd759c60d2 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:49.554812 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-4f8fd49e-6947-489d-b277-b7dd759c60d2 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:49.557162 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-2928e093-a6b7-48de-973a-46aebca0a588 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:49.564760 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2928e093-a6b7-48de-973a-46aebca0a588 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:49.565506 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2928e093-a6b7-48de-973a-46aebca0a588 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:49.566085 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2928e093-a6b7-48de-973a-46aebca0a588 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:49.567837 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2928e093-a6b7-48de-973a-46aebca0a588 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:49.567969 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4f8fd49e-6947-489d-b277-b7dd759c60d2 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:49.568601 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2928e093-a6b7-48de-973a-46aebca0a588 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:49.569193 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2928e093-a6b7-48de-973a-46aebca0a588 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:49.569734 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4f8fd49e-6947-489d-b277-b7dd759c60d2 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:49.570191 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4f8fd49e-6947-489d-b277-b7dd759c60d2 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:49.570890 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4f8fd49e-6947-489d-b277-b7dd759c60d2 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:49.571376 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4f8fd49e-6947-489d-b277-b7dd759c60d2 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:49.571808 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4f8fd49e-6947-489d-b277-b7dd759c60d2 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:49.639073 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-2928e093-a6b7-48de-973a-46aebca0a588 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:49.649724 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-2928e093-a6b7-48de-973a-46aebca0a588 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:49.652238 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-2928e093-a6b7-48de-973a-46aebca0a588 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:49.654013 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-2928e093-a6b7-48de-973a-46aebca0a588 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1338 microversion: 2.20 time: 0.109235 Sep 30 19:29:49.654749 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 82/138] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:29:49 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1338 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:29:49.733089 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-4f8fd49e-6947-489d-b277-b7dd759c60d2 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:49.745548 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-4f8fd49e-6947-489d-b277-b7dd759c60d2 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d" status: 200 len: 1366 microversion: 2.1 time: 0.192667 Sep 30 19:29:49.747115 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 57/139] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:49 2022] GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:29:49.750355 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-5f3908d0-ccbd-43d1-a317-acfe39cbae37 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:49.750986 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-5f3908d0-ccbd-43d1-a317-acfe39cbae37 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:49.757823 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5f3908d0-ccbd-43d1-a317-acfe39cbae37 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:49.758577 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5f3908d0-ccbd-43d1-a317-acfe39cbae37 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:49.759167 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5f3908d0-ccbd-43d1-a317-acfe39cbae37 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:49.760073 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5f3908d0-ccbd-43d1-a317-acfe39cbae37 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:49.760714 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5f3908d0-ccbd-43d1-a317-acfe39cbae37 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:49.761480 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5f3908d0-ccbd-43d1-a317-acfe39cbae37 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:49.912439 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-5f3908d0-ccbd-43d1-a317-acfe39cbae37 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:49.921264 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-5f3908d0-ccbd-43d1-a317-acfe39cbae37 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1322 microversion: 2.1 time: 0.175138 Sep 30 19:29:49.922114 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 83/140] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:49 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:29:50.307381 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-0cefbff6-1049-423a-a011-7f32c1753871 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:50.308303 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-0cefbff6-1049-423a-a011-7f32c1753871 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:50.314372 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0cefbff6-1049-423a-a011-7f32c1753871 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:50.315125 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0cefbff6-1049-423a-a011-7f32c1753871 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:50.315568 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0cefbff6-1049-423a-a011-7f32c1753871 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:50.317107 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0cefbff6-1049-423a-a011-7f32c1753871 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:50.317727 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0cefbff6-1049-423a-a011-7f32c1753871 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:50.318337 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0cefbff6-1049-423a-a011-7f32c1753871 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:50.426793 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-8e961b46-e792-4f15-ba25-c5a78f960889 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:50.427946 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-8e961b46-e792-4f15-ba25-c5a78f960889 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] [instance: 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:50.435781 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8e961b46-e792-4f15-ba25-c5a78f960889 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:50.436728 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8e961b46-e792-4f15-ba25-c5a78f960889 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:50.437406 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8e961b46-e792-4f15-ba25-c5a78f960889 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:50.438517 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8e961b46-e792-4f15-ba25-c5a78f960889 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:50.439202 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8e961b46-e792-4f15-ba25-c5a78f960889 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:50.439951 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8e961b46-e792-4f15-ba25-c5a78f960889 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:50.466233 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-0cefbff6-1049-423a-a011-7f32c1753871 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:50.476997 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-0cefbff6-1049-423a-a011-7f32c1753871 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1363 microversion: 2.1 time: 0.174114 Sep 30 19:29:50.479455 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 58/141] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:50 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:50.680173 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-67fdda6d-f949-4efc-8ece-18816aa38b13 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:50.681006 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-8e961b46-e792-4f15-ba25-c5a78f960889 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bb718f9153493ca6dda343d461c5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9758637e30e4089b394ed6ea5c2cf3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:50.681487 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-67fdda6d-f949-4efc-8ece-18816aa38b13 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:50.690858 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-67fdda6d-f949-4efc-8ece-18816aa38b13 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:50.691428 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-67fdda6d-f949-4efc-8ece-18816aa38b13 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:50.694414 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-67fdda6d-f949-4efc-8ece-18816aa38b13 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:50.695011 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-8e961b46-e792-4f15-ba25-c5a78f960889 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] 10.222.0.17 "GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf" status: 200 len: 1315 microversion: 2.1 time: 0.271446 Sep 30 19:29:50.695220 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-67fdda6d-f949-4efc-8ece-18816aa38b13 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:50.695953 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-67fdda6d-f949-4efc-8ece-18816aa38b13 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:50.696491 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 84/142] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:50 2022] GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:50.701276 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-67fdda6d-f949-4efc-8ece-18816aa38b13 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:50.780095 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-79ca910a-18d3-4870-af5b-8f80b01a7bbf tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:50.781125 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-79ca910a-18d3-4870-af5b-8f80b01a7bbf tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:50.788734 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-79ca910a-18d3-4870-af5b-8f80b01a7bbf tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:50.789501 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-79ca910a-18d3-4870-af5b-8f80b01a7bbf tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:50.790081 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-79ca910a-18d3-4870-af5b-8f80b01a7bbf tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:50.790960 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-79ca910a-18d3-4870-af5b-8f80b01a7bbf tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:50.791557 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-79ca910a-18d3-4870-af5b-8f80b01a7bbf tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:50.792274 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-79ca910a-18d3-4870-af5b-8f80b01a7bbf tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:50.803932 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-67fdda6d-f949-4efc-8ece-18816aa38b13 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:50.818434 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-67fdda6d-f949-4efc-8ece-18816aa38b13 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:50.819929 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-67fdda6d-f949-4efc-8ece-18816aa38b13 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:50.821094 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-67fdda6d-f949-4efc-8ece-18816aa38b13 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1338 microversion: 2.20 time: 0.144682 Sep 30 19:29:50.832836 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 59/143] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:29:50 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1338 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:29:50.947186 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-4be7c2a0-dc36-436b-a9f6-ff207cd358df tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:50.947408 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-4be7c2a0-dc36-436b-a9f6-ff207cd358df tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:50.953878 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4be7c2a0-dc36-436b-a9f6-ff207cd358df tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:50.954730 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4be7c2a0-dc36-436b-a9f6-ff207cd358df tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:50.954870 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4be7c2a0-dc36-436b-a9f6-ff207cd358df tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:50.955474 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4be7c2a0-dc36-436b-a9f6-ff207cd358df tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:50.955922 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4be7c2a0-dc36-436b-a9f6-ff207cd358df tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:50.956339 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4be7c2a0-dc36-436b-a9f6-ff207cd358df tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:51.159362 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-79ca910a-18d3-4870-af5b-8f80b01a7bbf tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:51.172426 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-79ca910a-18d3-4870-af5b-8f80b01a7bbf tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d" status: 200 len: 1366 microversion: 2.1 time: 0.406108 Sep 30 19:29:51.175226 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 85/144] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:50 2022] GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d => generated 1366 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:51.184665 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-06b3ff33-3384-4152-a819-ceb54b98fe67 req-296ae6e4-7b0a-413f-b3c1-d052d82e2440 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "304c3216-3e08-4ea0-9ca4-ab7d78a952a9", "tag": "f09c6fe2-495b-40c6-ab14-1c805dd88322"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:29:51.197422 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-06b3ff33-3384-4152-a819-ceb54b98fe67 req-296ae6e4-7b0a-413f-b3c1-d052d82e2440 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:51.198209 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-06b3ff33-3384-4152-a819-ceb54b98fe67 req-296ae6e4-7b0a-413f-b3c1-d052d82e2440 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:51.199293 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-06b3ff33-3384-4152-a819-ceb54b98fe67 req-296ae6e4-7b0a-413f-b3c1-d052d82e2440 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:51.224630 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-06b3ff33-3384-4152-a819-ceb54b98fe67 req-296ae6e4-7b0a-413f-b3c1-d052d82e2440 service nova] Creating event network-changed:f09c6fe2-495b-40c6-ab14-1c805dd88322 for instance 304c3216-3e08-4ea0-9ca4-ab7d78a952a9 on hv-cinder-86001 Sep 30 19:29:51.226319 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-4be7c2a0-dc36-436b-a9f6-ff207cd358df tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:51.231140 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-06b3ff33-3384-4152-a819-ceb54b98fe67 req-296ae6e4-7b0a-413f-b3c1-d052d82e2440 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054372 Sep 30 19:29:51.231938 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 86/145] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:29:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:29:51.238859 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-4be7c2a0-dc36-436b-a9f6-ff207cd358df tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1322 microversion: 2.1 time: 0.295158 Sep 30 19:29:51.256396 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 60/146] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:50 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1322 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:29:51.503896 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-b6cd755c-9125-4d62-83a3-808c37adb341 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:51.504660 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-b6cd755c-9125-4d62-83a3-808c37adb341 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:51.513757 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b6cd755c-9125-4d62-83a3-808c37adb341 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:51.514431 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b6cd755c-9125-4d62-83a3-808c37adb341 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:51.515014 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b6cd755c-9125-4d62-83a3-808c37adb341 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:51.516539 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b6cd755c-9125-4d62-83a3-808c37adb341 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:51.517153 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b6cd755c-9125-4d62-83a3-808c37adb341 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:51.518241 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b6cd755c-9125-4d62-83a3-808c37adb341 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:51.669337 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-b6cd755c-9125-4d62-83a3-808c37adb341 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:51.677104 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-b6cd755c-9125-4d62-83a3-808c37adb341 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1363 microversion: 2.1 time: 0.178736 Sep 30 19:29:51.677726 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 87/147] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:51 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:51.724052 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-0785c6d8-3366-45a1-8f62-2234642d3856 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:51.724897 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-0785c6d8-3366-45a1-8f62-2234642d3856 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] [instance: 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:51.731205 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0785c6d8-3366-45a1-8f62-2234642d3856 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:51.731696 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0785c6d8-3366-45a1-8f62-2234642d3856 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:51.732140 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0785c6d8-3366-45a1-8f62-2234642d3856 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:51.732861 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0785c6d8-3366-45a1-8f62-2234642d3856 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:51.733318 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0785c6d8-3366-45a1-8f62-2234642d3856 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:51.733750 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0785c6d8-3366-45a1-8f62-2234642d3856 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:51.849670 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-c9198237-5c66-4d8e-bc63-fbda0f5b7534 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:51.851133 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-c9198237-5c66-4d8e-bc63-fbda0f5b7534 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:51.863587 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c9198237-5c66-4d8e-bc63-fbda0f5b7534 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:51.864186 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c9198237-5c66-4d8e-bc63-fbda0f5b7534 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:51.864714 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c9198237-5c66-4d8e-bc63-fbda0f5b7534 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:51.865839 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c9198237-5c66-4d8e-bc63-fbda0f5b7534 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:51.866595 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c9198237-5c66-4d8e-bc63-fbda0f5b7534 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:51.867253 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c9198237-5c66-4d8e-bc63-fbda0f5b7534 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:51.887215 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-0785c6d8-3366-45a1-8f62-2234642d3856 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bb718f9153493ca6dda343d461c5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9758637e30e4089b394ed6ea5c2cf3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:51.896203 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-0785c6d8-3366-45a1-8f62-2234642d3856 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] 10.222.0.17 "GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf" status: 200 len: 1315 microversion: 2.1 time: 0.177889 Sep 30 19:29:51.912474 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 61/148] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:51 2022] GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:51.942138 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-c9198237-5c66-4d8e-bc63-fbda0f5b7534 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:51.950104 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-c9198237-5c66-4d8e-bc63-fbda0f5b7534 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:51.951545 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-c9198237-5c66-4d8e-bc63-fbda0f5b7534 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:51.952674 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-c9198237-5c66-4d8e-bc63-fbda0f5b7534 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1338 microversion: 2.20 time: 0.106868 Sep 30 19:29:51.953229 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 88/149] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:29:51 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1338 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:29:52.199367 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-4cbc328d-52d6-46f2-981b-a6fe448a169f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:52.200015 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-4cbc328d-52d6-46f2-981b-a6fe448a169f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:52.206559 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4cbc328d-52d6-46f2-981b-a6fe448a169f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:52.207049 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4cbc328d-52d6-46f2-981b-a6fe448a169f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:52.207481 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4cbc328d-52d6-46f2-981b-a6fe448a169f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:52.208179 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4cbc328d-52d6-46f2-981b-a6fe448a169f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:52.208654 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4cbc328d-52d6-46f2-981b-a6fe448a169f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:52.209078 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4cbc328d-52d6-46f2-981b-a6fe448a169f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:52.265480 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-6b25e8fc-d6a5-4e10-8a45-271518b6290e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:52.267513 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-6b25e8fc-d6a5-4e10-8a45-271518b6290e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:52.284943 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6b25e8fc-d6a5-4e10-8a45-271518b6290e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:52.285542 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6b25e8fc-d6a5-4e10-8a45-271518b6290e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:52.285979 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6b25e8fc-d6a5-4e10-8a45-271518b6290e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:52.287445 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6b25e8fc-d6a5-4e10-8a45-271518b6290e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:52.288127 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6b25e8fc-d6a5-4e10-8a45-271518b6290e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:52.288594 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6b25e8fc-d6a5-4e10-8a45-271518b6290e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:52.359429 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-4cbc328d-52d6-46f2-981b-a6fe448a169f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:52.369433 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-4cbc328d-52d6-46f2-981b-a6fe448a169f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d" status: 200 len: 1366 microversion: 2.1 time: 0.174042 Sep 30 19:29:52.370020 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 62/150] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:52 2022] GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:52.441675 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-6b25e8fc-d6a5-4e10-8a45-271518b6290e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:52.449732 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-6b25e8fc-d6a5-4e10-8a45-271518b6290e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1322 microversion: 2.1 time: 0.189168 Sep 30 19:29:52.450874 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 89/151] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:52 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:29:52.702363 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e184fda9-3202-41cc-beed-16a8ee4722db tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:52.702920 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-e184fda9-3202-41cc-beed-16a8ee4722db tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:52.709880 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e184fda9-3202-41cc-beed-16a8ee4722db tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:52.710368 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e184fda9-3202-41cc-beed-16a8ee4722db tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:52.710858 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e184fda9-3202-41cc-beed-16a8ee4722db tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:52.711555 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e184fda9-3202-41cc-beed-16a8ee4722db tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:52.712015 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e184fda9-3202-41cc-beed-16a8ee4722db tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:52.712565 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e184fda9-3202-41cc-beed-16a8ee4722db tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:52.764613 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [req-71e4866d-b44d-4f28-babd-60a2aa73532d req-adba0029-57a5-4136-bcfa-c971e4757424 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf", "name": "network-vif-plugged", "status": "completed", "tag": "0898c149-da59-4f69-9cfb-2f5ece95d7bf"}]} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:29:52.783658 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-71e4866d-b44d-4f28-babd-60a2aa73532d req-adba0029-57a5-4136-bcfa-c971e4757424 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:52.784464 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-71e4866d-b44d-4f28-babd-60a2aa73532d req-adba0029-57a5-4136-bcfa-c971e4757424 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:52.785754 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-71e4866d-b44d-4f28-babd-60a2aa73532d req-adba0029-57a5-4136-bcfa-c971e4757424 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:52.798503 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.compute.server_external_events [req-71e4866d-b44d-4f28-babd-60a2aa73532d req-adba0029-57a5-4136-bcfa-c971e4757424 service nova] Creating event network-vif-plugged:0898c149-da59-4f69-9cfb-2f5ece95d7bf for instance 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf on hv-cinder-86001 Sep 30 19:29:52.804141 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [req-71e4866d-b44d-4f28-babd-60a2aa73532d req-adba0029-57a5-4136-bcfa-c971e4757424 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112012 Sep 30 19:29:52.804944 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 63/152] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:29:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:29:52.920086 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-6d42f335-cec3-42e6-bfbc-bac03b1e108f tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:52.920811 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-6d42f335-cec3-42e6-bfbc-bac03b1e108f tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] [instance: 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:52.928491 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6d42f335-cec3-42e6-bfbc-bac03b1e108f tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:52.929199 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6d42f335-cec3-42e6-bfbc-bac03b1e108f tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:52.929896 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6d42f335-cec3-42e6-bfbc-bac03b1e108f tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:52.930837 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6d42f335-cec3-42e6-bfbc-bac03b1e108f tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:52.931513 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6d42f335-cec3-42e6-bfbc-bac03b1e108f tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:52.932143 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6d42f335-cec3-42e6-bfbc-bac03b1e108f tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:52.964277 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell1:SELECT=100 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:53.249751 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-e184fda9-3202-41cc-beed-16a8ee4722db tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:53.259519 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-e184fda9-3202-41cc-beed-16a8ee4722db tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1363 microversion: 2.1 time: 0.561184 Sep 30 19:29:53.276900 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 90/153] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:52 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1363 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:29:53.282187 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-d1173036-af03-4ba5-8a78-107f819d2c26 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:53.283013 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-d1173036-af03-4ba5-8a78-107f819d2c26 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:53.292826 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d1173036-af03-4ba5-8a78-107f819d2c26 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:53.301406 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d1173036-af03-4ba5-8a78-107f819d2c26 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:53.302565 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d1173036-af03-4ba5-8a78-107f819d2c26 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:53.303526 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d1173036-af03-4ba5-8a78-107f819d2c26 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:53.304193 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d1173036-af03-4ba5-8a78-107f819d2c26 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:53.305463 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d1173036-af03-4ba5-8a78-107f819d2c26 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:53.330158 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-6d42f335-cec3-42e6-bfbc-bac03b1e108f tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bb718f9153493ca6dda343d461c5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9758637e30e4089b394ed6ea5c2cf3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:53.337801 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-6d42f335-cec3-42e6-bfbc-bac03b1e108f tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] 10.222.0.17 "GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf" status: 200 len: 1315 microversion: 2.1 time: 0.421812 Sep 30 19:29:53.360417 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 64/154] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:52 2022] GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf => generated 1315 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:53.394775 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-105e422f-dfe2-4db4-8e3b-5e10c27d6050 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:53.395388 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-105e422f-dfe2-4db4-8e3b-5e10c27d6050 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:53.407652 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-105e422f-dfe2-4db4-8e3b-5e10c27d6050 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:53.408144 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-105e422f-dfe2-4db4-8e3b-5e10c27d6050 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:53.408603 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-105e422f-dfe2-4db4-8e3b-5e10c27d6050 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:53.409557 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-105e422f-dfe2-4db4-8e3b-5e10c27d6050 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:53.410585 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-105e422f-dfe2-4db4-8e3b-5e10c27d6050 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:53.411015 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-105e422f-dfe2-4db4-8e3b-5e10c27d6050 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:53.553147 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-d1173036-af03-4ba5-8a78-107f819d2c26 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:53.561980 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-d1173036-af03-4ba5-8a78-107f819d2c26 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:53.563482 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-d1173036-af03-4ba5-8a78-107f819d2c26 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:53.564609 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-d1173036-af03-4ba5-8a78-107f819d2c26 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1338 microversion: 2.20 time: 0.286337 Sep 30 19:29:53.565171 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 91/155] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:29:53 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1338 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:29:53.578272 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-f5ac8cc7-8c17-4b5f-b2bf-49e8d15e6a69 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:53.579406 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-f5ac8cc7-8c17-4b5f-b2bf-49e8d15e6a69 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:53.587587 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f5ac8cc7-8c17-4b5f-b2bf-49e8d15e6a69 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:53.588444 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f5ac8cc7-8c17-4b5f-b2bf-49e8d15e6a69 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:53.589111 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f5ac8cc7-8c17-4b5f-b2bf-49e8d15e6a69 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:53.590067 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f5ac8cc7-8c17-4b5f-b2bf-49e8d15e6a69 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:53.590730 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f5ac8cc7-8c17-4b5f-b2bf-49e8d15e6a69 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:53.591360 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f5ac8cc7-8c17-4b5f-b2bf-49e8d15e6a69 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:53.794309 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-105e422f-dfe2-4db4-8e3b-5e10c27d6050 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:53.804404 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-105e422f-dfe2-4db4-8e3b-5e10c27d6050 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d" status: 200 len: 1366 microversion: 2.1 time: 0.413371 Sep 30 19:29:53.805201 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 65/156] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:53 2022] GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d => generated 1366 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:54.059718 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f5ac8cc7-8c17-4b5f-b2bf-49e8d15e6a69 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:54.069692 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-f5ac8cc7-8c17-4b5f-b2bf-49e8d15e6a69 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1322 microversion: 2.1 time: 0.502223 Sep 30 19:29:54.070954 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 92/157] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:53 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1322 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:54.287998 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-89da1d38-fd63-48d7-9fc9-911867e18a13 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:54.288637 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-89da1d38-fd63-48d7-9fc9-911867e18a13 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:54.301410 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-89da1d38-fd63-48d7-9fc9-911867e18a13 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:54.302162 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-89da1d38-fd63-48d7-9fc9-911867e18a13 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:54.302671 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-89da1d38-fd63-48d7-9fc9-911867e18a13 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:54.307147 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-89da1d38-fd63-48d7-9fc9-911867e18a13 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:54.307915 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-89da1d38-fd63-48d7-9fc9-911867e18a13 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:54.308802 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-89da1d38-fd63-48d7-9fc9-911867e18a13 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:54.375878 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-2d06d0ff-9082-4057-9399-2bb6913af626 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:54.384585 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-2d06d0ff-9082-4057-9399-2bb6913af626 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] [instance: 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:54.426186 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2d06d0ff-9082-4057-9399-2bb6913af626 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:54.429414 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2d06d0ff-9082-4057-9399-2bb6913af626 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:54.434942 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2d06d0ff-9082-4057-9399-2bb6913af626 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:54.436097 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2d06d0ff-9082-4057-9399-2bb6913af626 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:54.436852 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2d06d0ff-9082-4057-9399-2bb6913af626 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:54.437494 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2d06d0ff-9082-4057-9399-2bb6913af626 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:54.748088 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-89da1d38-fd63-48d7-9fc9-911867e18a13 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:54.760779 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-89da1d38-fd63-48d7-9fc9-911867e18a13 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1363 microversion: 2.1 time: 0.476675 Sep 30 19:29:54.762743 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 66/158] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:54 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1363 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:54.787013 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-5419291a-9c82-4824-ad30-cedfb3a9057f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:54.790421 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-5419291a-9c82-4824-ad30-cedfb3a9057f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:54.798719 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5419291a-9c82-4824-ad30-cedfb3a9057f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:54.799317 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5419291a-9c82-4824-ad30-cedfb3a9057f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:54.799704 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5419291a-9c82-4824-ad30-cedfb3a9057f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:54.800482 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5419291a-9c82-4824-ad30-cedfb3a9057f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:54.801616 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5419291a-9c82-4824-ad30-cedfb3a9057f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:54.801984 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5419291a-9c82-4824-ad30-cedfb3a9057f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:54.877539 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-2d06d0ff-9082-4057-9399-2bb6913af626 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bb718f9153493ca6dda343d461c5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9758637e30e4089b394ed6ea5c2cf3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:54.885892 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-2d06d0ff-9082-4057-9399-2bb6913af626 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] 10.222.0.17 "GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf" status: 200 len: 1315 microversion: 2.1 time: 0.514006 Sep 30 19:29:54.887315 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 93/159] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:54 2022] GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf => generated 1315 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:29:54.891974 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-3de9df0f-c41d-41d6-9272-aa3f11135c05 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:54.893345 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-3de9df0f-c41d-41d6-9272-aa3f11135c05 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:54.899523 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3de9df0f-c41d-41d6-9272-aa3f11135c05 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:54.900356 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3de9df0f-c41d-41d6-9272-aa3f11135c05 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:54.900955 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3de9df0f-c41d-41d6-9272-aa3f11135c05 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:54.901803 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3de9df0f-c41d-41d6-9272-aa3f11135c05 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:54.902250 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3de9df0f-c41d-41d6-9272-aa3f11135c05 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:54.902669 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3de9df0f-c41d-41d6-9272-aa3f11135c05 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:55.068022 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-5419291a-9c82-4824-ad30-cedfb3a9057f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:55.082365 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-5419291a-9c82-4824-ad30-cedfb3a9057f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:55.088137 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-5419291a-9c82-4824-ad30-cedfb3a9057f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:55.089559 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-5419291a-9c82-4824-ad30-cedfb3a9057f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1406 microversion: 2.20 time: 0.323721 Sep 30 19:29:55.106927 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 67/160] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:29:54 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1406 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:29:55.114969 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-5778a1ea-5f6c-4e30-a1ef-bb96ecaf8be5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:55.115883 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-5778a1ea-5f6c-4e30-a1ef-bb96ecaf8be5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:55.124042 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5778a1ea-5f6c-4e30-a1ef-bb96ecaf8be5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:55.125214 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5778a1ea-5f6c-4e30-a1ef-bb96ecaf8be5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:55.125903 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5778a1ea-5f6c-4e30-a1ef-bb96ecaf8be5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:55.136271 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5778a1ea-5f6c-4e30-a1ef-bb96ecaf8be5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:55.137344 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5778a1ea-5f6c-4e30-a1ef-bb96ecaf8be5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:55.138010 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5778a1ea-5f6c-4e30-a1ef-bb96ecaf8be5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:55.222998 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-3de9df0f-c41d-41d6-9272-aa3f11135c05 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:55.248009 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-3de9df0f-c41d-41d6-9272-aa3f11135c05 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d" status: 200 len: 1366 microversion: 2.1 time: 0.359446 Sep 30 19:29:55.269773 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 94/161] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:54 2022] GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d => generated 1366 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:55.491869 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-5778a1ea-5f6c-4e30-a1ef-bb96ecaf8be5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:55.499586 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-5778a1ea-5f6c-4e30-a1ef-bb96ecaf8be5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1322 microversion: 2.1 time: 0.391160 Sep 30 19:29:55.500153 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 68/162] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:55 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1322 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:55.739693 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-cc64421a-5853-4fb3-be62-be7e56a7b90a req-274ea217-ffff-40de-bef6-b2b489d36e6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c87cf7d2-5d47-474b-b2f0-1ddc37bc97df", "tag": "408315e4-bcde-4577-8c32-5d47d233c194"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:29:55.756538 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-cc64421a-5853-4fb3-be62-be7e56a7b90a req-274ea217-ffff-40de-bef6-b2b489d36e6d service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:55.757017 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-cc64421a-5853-4fb3-be62-be7e56a7b90a req-274ea217-ffff-40de-bef6-b2b489d36e6d service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:55.757532 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-cc64421a-5853-4fb3-be62-be7e56a7b90a req-274ea217-ffff-40de-bef6-b2b489d36e6d service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:55.769988 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-cc64421a-5853-4fb3-be62-be7e56a7b90a req-274ea217-ffff-40de-bef6-b2b489d36e6d service nova] Creating event network-changed:408315e4-bcde-4577-8c32-5d47d233c194 for instance c87cf7d2-5d47-474b-b2f0-1ddc37bc97df on hv-cinder-86001 Sep 30 19:29:55.775244 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-cc64421a-5853-4fb3-be62-be7e56a7b90a req-274ea217-ffff-40de-bef6-b2b489d36e6d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039379 Sep 30 19:29:55.775842 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 95/163] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 30 19:29:55.790596 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-98bc8656-4caf-4ae9-b5a3-198eb2224478 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:55.792757 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-98bc8656-4caf-4ae9-b5a3-198eb2224478 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:55.799169 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-98bc8656-4caf-4ae9-b5a3-198eb2224478 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:55.799744 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-98bc8656-4caf-4ae9-b5a3-198eb2224478 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:55.800071 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-98bc8656-4caf-4ae9-b5a3-198eb2224478 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:55.801360 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-98bc8656-4caf-4ae9-b5a3-198eb2224478 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:55.802424 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-98bc8656-4caf-4ae9-b5a3-198eb2224478 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:55.802885 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-98bc8656-4caf-4ae9-b5a3-198eb2224478 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:55.908552 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-832a4675-9ae0-4915-875b-cb17162dee81 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:55.909506 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-832a4675-9ae0-4915-875b-cb17162dee81 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] [instance: 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:55.916383 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-832a4675-9ae0-4915-875b-cb17162dee81 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:55.916903 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-832a4675-9ae0-4915-875b-cb17162dee81 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:55.917329 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-832a4675-9ae0-4915-875b-cb17162dee81 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:55.918013 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-832a4675-9ae0-4915-875b-cb17162dee81 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:55.918459 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-832a4675-9ae0-4915-875b-cb17162dee81 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:55.918880 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-832a4675-9ae0-4915-875b-cb17162dee81 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:55.922974 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=100 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:55.939968 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-98bc8656-4caf-4ae9-b5a3-198eb2224478 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:55.948113 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-98bc8656-4caf-4ae9-b5a3-198eb2224478 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1363 microversion: 2.1 time: 0.162385 Sep 30 19:29:55.948711 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 69/164] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:55 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:56.048538 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-832a4675-9ae0-4915-875b-cb17162dee81 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bb718f9153493ca6dda343d461c5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9758637e30e4089b394ed6ea5c2cf3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:56.056866 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-832a4675-9ae0-4915-875b-cb17162dee81 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] 10.222.0.17 "GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf" status: 200 len: 1315 microversion: 2.1 time: 0.152414 Sep 30 19:29:56.057467 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 96/165] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:55 2022] GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:29:56.113998 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-1cc3a820-6a98-4af4-8f71-1aef0174b7e3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:56.114561 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-1cc3a820-6a98-4af4-8f71-1aef0174b7e3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:56.120393 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1cc3a820-6a98-4af4-8f71-1aef0174b7e3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:56.120904 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1cc3a820-6a98-4af4-8f71-1aef0174b7e3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:56.121345 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1cc3a820-6a98-4af4-8f71-1aef0174b7e3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:56.122034 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1cc3a820-6a98-4af4-8f71-1aef0174b7e3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:56.122515 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1cc3a820-6a98-4af4-8f71-1aef0174b7e3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:56.122943 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1cc3a820-6a98-4af4-8f71-1aef0174b7e3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:56.249452 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-1cc3a820-6a98-4af4-8f71-1aef0174b7e3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:56.258070 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-1cc3a820-6a98-4af4-8f71-1aef0174b7e3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:56.259576 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-1cc3a820-6a98-4af4-8f71-1aef0174b7e3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:56.260711 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-1cc3a820-6a98-4af4-8f71-1aef0174b7e3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1406 microversion: 2.20 time: 0.151313 Sep 30 19:29:56.261270 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 70/166] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:29:56 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:29:56.304882 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-0edc701a-cd6e-466f-9841-5fdacefe1582 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:56.305491 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-0edc701a-cd6e-466f-9841-5fdacefe1582 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:56.311270 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0edc701a-cd6e-466f-9841-5fdacefe1582 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:56.311755 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0edc701a-cd6e-466f-9841-5fdacefe1582 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:56.312210 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0edc701a-cd6e-466f-9841-5fdacefe1582 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:56.312935 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0edc701a-cd6e-466f-9841-5fdacefe1582 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:56.313394 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0edc701a-cd6e-466f-9841-5fdacefe1582 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:56.313823 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0edc701a-cd6e-466f-9841-5fdacefe1582 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:56.457165 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-0edc701a-cd6e-466f-9841-5fdacefe1582 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:56.465481 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-0edc701a-cd6e-466f-9841-5fdacefe1582 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d" status: 200 len: 1366 microversion: 2.1 time: 0.164860 Sep 30 19:29:56.466305 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 97/167] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:56 2022] GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:56.531025 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-b888a184-c590-4b0f-a5b4-e1506ba4ba7c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:56.531624 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-b888a184-c590-4b0f-a5b4-e1506ba4ba7c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:56.538443 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b888a184-c590-4b0f-a5b4-e1506ba4ba7c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:56.538922 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b888a184-c590-4b0f-a5b4-e1506ba4ba7c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:56.539354 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b888a184-c590-4b0f-a5b4-e1506ba4ba7c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:56.540037 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b888a184-c590-4b0f-a5b4-e1506ba4ba7c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:56.540512 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b888a184-c590-4b0f-a5b4-e1506ba4ba7c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:56.540936 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b888a184-c590-4b0f-a5b4-e1506ba4ba7c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:56.694464 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-b888a184-c590-4b0f-a5b4-e1506ba4ba7c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:56.702051 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-b888a184-c590-4b0f-a5b4-e1506ba4ba7c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1322 microversion: 2.1 time: 0.174984 Sep 30 19:29:56.702615 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 71/168] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:56 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:56.826005 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-9246f7a8-5996-465f-bfae-066af243e00e req-b86d85db-2123-4a34-a79e-d6391041ffb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fd6c296-8008-4f27-82c0-36839a4eec3f", "name": "network-vif-plugged", "status": "completed", "tag": "6ac4279f-c732-4cbf-8ee8-224018cd79f8"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:29:56.831887 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=100 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:56.836240 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-9246f7a8-5996-465f-bfae-066af243e00e req-b86d85db-2123-4a34-a79e-d6391041ffb7 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:56.836742 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-9246f7a8-5996-465f-bfae-066af243e00e req-b86d85db-2123-4a34-a79e-d6391041ffb7 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:56.838096 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-9246f7a8-5996-465f-bfae-066af243e00e req-b86d85db-2123-4a34-a79e-d6391041ffb7 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:56.850701 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-9246f7a8-5996-465f-bfae-066af243e00e req-b86d85db-2123-4a34-a79e-d6391041ffb7 service nova] Creating event network-vif-plugged:6ac4279f-c732-4cbf-8ee8-224018cd79f8 for instance 5fd6c296-8008-4f27-82c0-36839a4eec3f on hv-cinder-86001 Sep 30 19:29:56.855951 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-9246f7a8-5996-465f-bfae-066af243e00e req-b86d85db-2123-4a34-a79e-d6391041ffb7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033592 Sep 30 19:29:56.856733 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 98/169] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:29:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:29:56.970682 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-5367dd8d-51fd-4f40-88ad-69e296fa1fb4 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:56.971279 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-5367dd8d-51fd-4f40-88ad-69e296fa1fb4 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:56.977988 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5367dd8d-51fd-4f40-88ad-69e296fa1fb4 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:56.978480 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5367dd8d-51fd-4f40-88ad-69e296fa1fb4 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:56.978914 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5367dd8d-51fd-4f40-88ad-69e296fa1fb4 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:56.979607 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5367dd8d-51fd-4f40-88ad-69e296fa1fb4 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:56.980061 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5367dd8d-51fd-4f40-88ad-69e296fa1fb4 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:56.980523 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5367dd8d-51fd-4f40-88ad-69e296fa1fb4 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:57.081372 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-1d3eb0e7-3679-42f3-9150-de0b97460029 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:57.082064 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-1d3eb0e7-3679-42f3-9150-de0b97460029 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] [instance: 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:57.088904 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1d3eb0e7-3679-42f3-9150-de0b97460029 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:57.089387 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1d3eb0e7-3679-42f3-9150-de0b97460029 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:57.089821 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1d3eb0e7-3679-42f3-9150-de0b97460029 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:57.090514 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1d3eb0e7-3679-42f3-9150-de0b97460029 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:57.090964 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1d3eb0e7-3679-42f3-9150-de0b97460029 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:57.091382 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1d3eb0e7-3679-42f3-9150-de0b97460029 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:57.120551 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-5367dd8d-51fd-4f40-88ad-69e296fa1fb4 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:57.131225 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-5367dd8d-51fd-4f40-88ad-69e296fa1fb4 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1363 microversion: 2.1 time: 0.164340 Sep 30 19:29:57.132066 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 72/170] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:56 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:57.235209 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-1d3eb0e7-3679-42f3-9150-de0b97460029 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bb718f9153493ca6dda343d461c5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9758637e30e4089b394ed6ea5c2cf3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:57.244460 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-1d3eb0e7-3679-42f3-9150-de0b97460029 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] 10.222.0.17 "GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf" status: 200 len: 1315 microversion: 2.1 time: 0.166360 Sep 30 19:29:57.245034 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 99/171] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:57 2022] GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:57.286072 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-7fffec83-7083-4b1a-a9bc-8390d2a247db tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:57.286667 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-7fffec83-7083-4b1a-a9bc-8390d2a247db tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:57.293742 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7fffec83-7083-4b1a-a9bc-8390d2a247db tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:57.294222 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7fffec83-7083-4b1a-a9bc-8390d2a247db tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:57.294659 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7fffec83-7083-4b1a-a9bc-8390d2a247db tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:57.295341 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7fffec83-7083-4b1a-a9bc-8390d2a247db tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:57.295787 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7fffec83-7083-4b1a-a9bc-8390d2a247db tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:57.296205 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7fffec83-7083-4b1a-a9bc-8390d2a247db tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:57.466659 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-7fffec83-7083-4b1a-a9bc-8390d2a247db tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:57.475362 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-7fffec83-7083-4b1a-a9bc-8390d2a247db tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:57.476838 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-7fffec83-7083-4b1a-a9bc-8390d2a247db tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:57.477942 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-7fffec83-7083-4b1a-a9bc-8390d2a247db tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1406 microversion: 2.20 time: 0.196627 Sep 30 19:29:57.488432 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 73/172] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:29:57 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1406 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:29:57.495373 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-11f6d63e-8839-4f25-b677-c1b315fbc5c9 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:57.495373 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-11f6d63e-8839-4f25-b677-c1b315fbc5c9 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:57.496844 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-11f6d63e-8839-4f25-b677-c1b315fbc5c9 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:57.497323 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-11f6d63e-8839-4f25-b677-c1b315fbc5c9 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:57.497753 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-11f6d63e-8839-4f25-b677-c1b315fbc5c9 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:57.498435 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-11f6d63e-8839-4f25-b677-c1b315fbc5c9 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:57.498881 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-11f6d63e-8839-4f25-b677-c1b315fbc5c9 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:57.499298 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-11f6d63e-8839-4f25-b677-c1b315fbc5c9 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:57.634641 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-11f6d63e-8839-4f25-b677-c1b315fbc5c9 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:57.651840 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-11f6d63e-8839-4f25-b677-c1b315fbc5c9 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d" status: 200 len: 1366 microversion: 2.1 time: 0.165926 Sep 30 19:29:57.654620 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 100/173] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:57 2022] GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:57.726423 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-75a807f8-3a3f-4a67-aa3d-6352e1e8a4dc tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:57.727000 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-75a807f8-3a3f-4a67-aa3d-6352e1e8a4dc tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:57.738924 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell0:SELECT=2 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:57.745907 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-75a807f8-3a3f-4a67-aa3d-6352e1e8a4dc tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:57.746368 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-75a807f8-3a3f-4a67-aa3d-6352e1e8a4dc tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:57.747542 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-75a807f8-3a3f-4a67-aa3d-6352e1e8a4dc tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:57.748259 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-75a807f8-3a3f-4a67-aa3d-6352e1e8a4dc tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:57.748723 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-75a807f8-3a3f-4a67-aa3d-6352e1e8a4dc tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:57.749399 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-75a807f8-3a3f-4a67-aa3d-6352e1e8a4dc tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:57.895524 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-75a807f8-3a3f-4a67-aa3d-6352e1e8a4dc tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:57.905271 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-75a807f8-3a3f-4a67-aa3d-6352e1e8a4dc tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1322 microversion: 2.1 time: 0.183910 Sep 30 19:29:57.906052 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 74/174] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:57 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:58.154955 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-c7d4171f-3bd5-4894-8073-e4b09b757b51 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:58.155653 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-c7d4171f-3bd5-4894-8073-e4b09b757b51 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:58.161754 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c7d4171f-3bd5-4894-8073-e4b09b757b51 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:58.162236 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c7d4171f-3bd5-4894-8073-e4b09b757b51 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:58.162671 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c7d4171f-3bd5-4894-8073-e4b09b757b51 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:58.163386 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c7d4171f-3bd5-4894-8073-e4b09b757b51 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:58.163832 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c7d4171f-3bd5-4894-8073-e4b09b757b51 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:58.164253 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c7d4171f-3bd5-4894-8073-e4b09b757b51 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:58.267926 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-87061d09-058a-4b0f-b4b2-08307f66f909 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:58.269255 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-87061d09-058a-4b0f-b4b2-08307f66f909 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] [instance: 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:58.277174 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-87061d09-058a-4b0f-b4b2-08307f66f909 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:58.278203 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-87061d09-058a-4b0f-b4b2-08307f66f909 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:58.278791 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-87061d09-058a-4b0f-b4b2-08307f66f909 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:58.279817 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-87061d09-058a-4b0f-b4b2-08307f66f909 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:58.280827 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-87061d09-058a-4b0f-b4b2-08307f66f909 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:58.281544 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-87061d09-058a-4b0f-b4b2-08307f66f909 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:58.368656 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-c7d4171f-3bd5-4894-8073-e4b09b757b51 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:58.394204 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-c7d4171f-3bd5-4894-8073-e4b09b757b51 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1363 microversion: 2.1 time: 0.242934 Sep 30 19:29:58.395456 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 101/175] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:58 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1363 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:58.472742 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-87061d09-058a-4b0f-b4b2-08307f66f909 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bb718f9153493ca6dda343d461c5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9758637e30e4089b394ed6ea5c2cf3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:58.482858 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-87061d09-058a-4b0f-b4b2-08307f66f909 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] 10.222.0.17 "GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf" status: 200 len: 1315 microversion: 2.1 time: 0.219212 Sep 30 19:29:58.484113 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 75/176] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:58 2022] GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:58.504007 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-c9bc4bc6-74ed-4739-9e0d-13b7857d413c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:58.505183 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-c9bc4bc6-74ed-4739-9e0d-13b7857d413c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:58.511321 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c9bc4bc6-74ed-4739-9e0d-13b7857d413c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:58.512193 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c9bc4bc6-74ed-4739-9e0d-13b7857d413c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:58.512772 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c9bc4bc6-74ed-4739-9e0d-13b7857d413c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:58.513591 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c9bc4bc6-74ed-4739-9e0d-13b7857d413c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:58.514052 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c9bc4bc6-74ed-4739-9e0d-13b7857d413c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:58.514483 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c9bc4bc6-74ed-4739-9e0d-13b7857d413c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:58.643952 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-c9bc4bc6-74ed-4739-9e0d-13b7857d413c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:58.652134 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-c9bc4bc6-74ed-4739-9e0d-13b7857d413c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:58.653651 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-c9bc4bc6-74ed-4739-9e0d-13b7857d413c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:58.654736 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-c9bc4bc6-74ed-4739-9e0d-13b7857d413c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1406 microversion: 2.20 time: 0.156216 Sep 30 19:29:58.655275 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 102/177] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:29:58 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:29:58.677523 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-0a7bd955-d75b-4ac3-8426-7b35f845f426 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:58.678047 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-0a7bd955-d75b-4ac3-8426-7b35f845f426 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:58.680932 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_api:SELECT=100 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:58.684639 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0a7bd955-d75b-4ac3-8426-7b35f845f426 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:58.685120 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0a7bd955-d75b-4ac3-8426-7b35f845f426 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:58.685581 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0a7bd955-d75b-4ac3-8426-7b35f845f426 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:58.686330 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0a7bd955-d75b-4ac3-8426-7b35f845f426 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:58.686783 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0a7bd955-d75b-4ac3-8426-7b35f845f426 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:58.687199 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0a7bd955-d75b-4ac3-8426-7b35f845f426 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:58.846655 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-0a7bd955-d75b-4ac3-8426-7b35f845f426 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:58.855550 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-0a7bd955-d75b-4ac3-8426-7b35f845f426 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d" status: 200 len: 1366 microversion: 2.1 time: 0.181900 Sep 30 19:29:58.871158 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 76/178] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:58 2022] GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:58.929948 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-37b85a67-a1a4-4c7b-8b2c-4e88c544eac8 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:58.930756 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-37b85a67-a1a4-4c7b-8b2c-4e88c544eac8 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:58.937457 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-37b85a67-a1a4-4c7b-8b2c-4e88c544eac8 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:58.937947 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-37b85a67-a1a4-4c7b-8b2c-4e88c544eac8 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:58.938379 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-37b85a67-a1a4-4c7b-8b2c-4e88c544eac8 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:58.939065 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-37b85a67-a1a4-4c7b-8b2c-4e88c544eac8 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:58.939712 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-37b85a67-a1a4-4c7b-8b2c-4e88c544eac8 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:58.940205 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-37b85a67-a1a4-4c7b-8b2c-4e88c544eac8 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:59.082339 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-37b85a67-a1a4-4c7b-8b2c-4e88c544eac8 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:59.090799 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-37b85a67-a1a4-4c7b-8b2c-4e88c544eac8 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1322 microversion: 2.1 time: 0.165075 Sep 30 19:29:59.091449 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 103/179] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:58 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:59.421995 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-4b19e2ae-0e17-4d2a-a5bd-cc23af49871c tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:59.422763 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-4b19e2ae-0e17-4d2a-a5bd-cc23af49871c tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:59.429133 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4b19e2ae-0e17-4d2a-a5bd-cc23af49871c tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:59.429617 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4b19e2ae-0e17-4d2a-a5bd-cc23af49871c tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:59.430042 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4b19e2ae-0e17-4d2a-a5bd-cc23af49871c tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:59.430717 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4b19e2ae-0e17-4d2a-a5bd-cc23af49871c tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:59.431165 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4b19e2ae-0e17-4d2a-a5bd-cc23af49871c tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:59.431582 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4b19e2ae-0e17-4d2a-a5bd-cc23af49871c tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:59.508388 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-5bd6651f-64d8-42d8-aa52-5fa1fa2a35e2 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:59.508998 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-5bd6651f-64d8-42d8-aa52-5fa1fa2a35e2 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] [instance: 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:59.515382 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5bd6651f-64d8-42d8-aa52-5fa1fa2a35e2 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:59.515859 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5bd6651f-64d8-42d8-aa52-5fa1fa2a35e2 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:59.516293 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5bd6651f-64d8-42d8-aa52-5fa1fa2a35e2 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:59.517017 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5bd6651f-64d8-42d8-aa52-5fa1fa2a35e2 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:59.517457 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5bd6651f-64d8-42d8-aa52-5fa1fa2a35e2 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:59.517874 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5bd6651f-64d8-42d8-aa52-5fa1fa2a35e2 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:59.570770 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-4b19e2ae-0e17-4d2a-a5bd-cc23af49871c tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:59.578376 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-4b19e2ae-0e17-4d2a-a5bd-cc23af49871c tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1363 microversion: 2.1 time: 0.160254 Sep 30 19:29:59.587929 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 77/180] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:59 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:29:59.657013 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-5bd6651f-64d8-42d8-aa52-5fa1fa2a35e2 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bb718f9153493ca6dda343d461c5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9758637e30e4089b394ed6ea5c2cf3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:59.665302 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-5bd6651f-64d8-42d8-aa52-5fa1fa2a35e2 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] 10.222.0.17 "GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf" status: 200 len: 1502 microversion: 2.1 time: 0.161613 Sep 30 19:29:59.665959 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 104/181] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:59 2022] GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf => generated 1502 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:29:59.680721 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-67e8b15e-0612-4060-aac2-0f7e2806e558 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:59.681526 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-67e8b15e-0612-4060-aac2-0f7e2806e558 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:59.687672 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-67e8b15e-0612-4060-aac2-0f7e2806e558 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:59.688161 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-67e8b15e-0612-4060-aac2-0f7e2806e558 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:59.688615 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-67e8b15e-0612-4060-aac2-0f7e2806e558 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:59.689308 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-67e8b15e-0612-4060-aac2-0f7e2806e558 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:59.689759 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-67e8b15e-0612-4060-aac2-0f7e2806e558 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:59.690481 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-67e8b15e-0612-4060-aac2-0f7e2806e558 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:59.830143 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-67e8b15e-0612-4060-aac2-0f7e2806e558 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:59.840004 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-67e8b15e-0612-4060-aac2-0f7e2806e558 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:59.841700 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-67e8b15e-0612-4060-aac2-0f7e2806e558 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:29:59.842829 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-67e8b15e-0612-4060-aac2-0f7e2806e558 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1406 microversion: 2.20 time: 0.165899 Sep 30 19:29:59.843802 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 78/182] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:29:59 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:29:59.879015 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-1e478656-5337-4df9-956d-96f8e3deb18d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:29:59.879563 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-1e478656-5337-4df9-956d-96f8e3deb18d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:29:59.885389 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1e478656-5337-4df9-956d-96f8e3deb18d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:59.885870 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1e478656-5337-4df9-956d-96f8e3deb18d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:59.886302 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1e478656-5337-4df9-956d-96f8e3deb18d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:29:59.886993 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1e478656-5337-4df9-956d-96f8e3deb18d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:29:59.887444 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1e478656-5337-4df9-956d-96f8e3deb18d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:29:59.887864 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1e478656-5337-4df9-956d-96f8e3deb18d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:00.069283 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-1e478656-5337-4df9-956d-96f8e3deb18d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:00.078032 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-1e478656-5337-4df9-956d-96f8e3deb18d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d" status: 200 len: 1366 microversion: 2.1 time: 0.203327 Sep 30 19:30:00.078724 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 105/183] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:29:59 2022] GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:30:00.114140 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-c4dbcd2e-60ed-4427-b3cc-2dccee1b4083 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:00.114830 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-c4dbcd2e-60ed-4427-b3cc-2dccee1b4083 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:00.120934 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c4dbcd2e-60ed-4427-b3cc-2dccee1b4083 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:00.121624 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c4dbcd2e-60ed-4427-b3cc-2dccee1b4083 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:00.122062 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c4dbcd2e-60ed-4427-b3cc-2dccee1b4083 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:00.122756 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c4dbcd2e-60ed-4427-b3cc-2dccee1b4083 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:00.123210 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c4dbcd2e-60ed-4427-b3cc-2dccee1b4083 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:00.123652 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c4dbcd2e-60ed-4427-b3cc-2dccee1b4083 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:00.262949 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-c4dbcd2e-60ed-4427-b3cc-2dccee1b4083 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:00.271435 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-c4dbcd2e-60ed-4427-b3cc-2dccee1b4083 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1322 microversion: 2.1 time: 0.161215 Sep 30 19:30:00.272091 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 79/184] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:00 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:30:00.601546 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-0c0a8cfb-f737-4c3c-a2c3-058f6ba8b032 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:00.602102 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-0c0a8cfb-f737-4c3c-a2c3-058f6ba8b032 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:00.611237 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0c0a8cfb-f737-4c3c-a2c3-058f6ba8b032 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:00.611746 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0c0a8cfb-f737-4c3c-a2c3-058f6ba8b032 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:00.612178 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0c0a8cfb-f737-4c3c-a2c3-058f6ba8b032 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:00.613571 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0c0a8cfb-f737-4c3c-a2c3-058f6ba8b032 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:00.614025 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0c0a8cfb-f737-4c3c-a2c3-058f6ba8b032 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:00.614443 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0c0a8cfb-f737-4c3c-a2c3-058f6ba8b032 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:00.741517 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-0c0a8cfb-f737-4c3c-a2c3-058f6ba8b032 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:00.749109 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-0c0a8cfb-f737-4c3c-a2c3-058f6ba8b032 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1363 microversion: 2.1 time: 0.152207 Sep 30 19:30:00.749667 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 106/185] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:00 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:30:00.867853 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-a07eb373-b5ac-47d3-ba3e-10e46d315cbd tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:00.868576 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-a07eb373-b5ac-47d3-ba3e-10e46d315cbd tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:00.874330 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a07eb373-b5ac-47d3-ba3e-10e46d315cbd tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:00.874812 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a07eb373-b5ac-47d3-ba3e-10e46d315cbd tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:00.875248 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a07eb373-b5ac-47d3-ba3e-10e46d315cbd tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:00.875925 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a07eb373-b5ac-47d3-ba3e-10e46d315cbd tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:00.876386 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a07eb373-b5ac-47d3-ba3e-10e46d315cbd tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:00.876817 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a07eb373-b5ac-47d3-ba3e-10e46d315cbd tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:01.004387 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-a07eb373-b5ac-47d3-ba3e-10e46d315cbd tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:01.012436 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-a07eb373-b5ac-47d3-ba3e-10e46d315cbd tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:01.013979 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-a07eb373-b5ac-47d3-ba3e-10e46d315cbd tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:01.015119 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-a07eb373-b5ac-47d3-ba3e-10e46d315cbd tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1406 microversion: 2.20 time: 0.151268 Sep 30 19:30:01.015670 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 80/186] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:30:00 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:30:01.103787 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-11da1944-7230-4822-b11e-2a666143cc0e tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:01.104425 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-11da1944-7230-4822-b11e-2a666143cc0e tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:01.113529 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-11da1944-7230-4822-b11e-2a666143cc0e tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:01.114409 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-11da1944-7230-4822-b11e-2a666143cc0e tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:01.115224 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-11da1944-7230-4822-b11e-2a666143cc0e tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:01.116488 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-11da1944-7230-4822-b11e-2a666143cc0e tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:01.117002 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-11da1944-7230-4822-b11e-2a666143cc0e tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:01.117733 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-11da1944-7230-4822-b11e-2a666143cc0e tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:01.249565 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-11da1944-7230-4822-b11e-2a666143cc0e tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:01.260096 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-11da1944-7230-4822-b11e-2a666143cc0e tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d" status: 200 len: 1366 microversion: 2.1 time: 0.160996 Sep 30 19:30:01.260762 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 107/187] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:01 2022] GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:30:01.294438 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-fb520b87-833d-4ff0-b33e-573e10792431 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:01.295054 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-fb520b87-833d-4ff0-b33e-573e10792431 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:01.301481 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-fb520b87-833d-4ff0-b33e-573e10792431 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:01.301989 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-fb520b87-833d-4ff0-b33e-573e10792431 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:01.302430 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-fb520b87-833d-4ff0-b33e-573e10792431 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:01.303177 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-fb520b87-833d-4ff0-b33e-573e10792431 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:01.303635 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-fb520b87-833d-4ff0-b33e-573e10792431 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:01.304062 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-fb520b87-833d-4ff0-b33e-573e10792431 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:01.307970 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell1:SELECT=100 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:01.432611 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-fb520b87-833d-4ff0-b33e-573e10792431 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:01.440240 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-fb520b87-833d-4ff0-b33e-573e10792431 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1322 microversion: 2.1 time: 0.149559 Sep 30 19:30:01.440837 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 81/188] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:01 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:30:01.771870 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-6d7382f1-8b75-4ca2-9ac1-9020f816246e tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:01.772518 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-6d7382f1-8b75-4ca2-9ac1-9020f816246e tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:01.778376 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6d7382f1-8b75-4ca2-9ac1-9020f816246e tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:01.778861 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6d7382f1-8b75-4ca2-9ac1-9020f816246e tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:01.779296 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6d7382f1-8b75-4ca2-9ac1-9020f816246e tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:01.779982 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6d7382f1-8b75-4ca2-9ac1-9020f816246e tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:01.780461 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6d7382f1-8b75-4ca2-9ac1-9020f816246e tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:01.780887 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6d7382f1-8b75-4ca2-9ac1-9020f816246e tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:01.911986 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-6d7382f1-8b75-4ca2-9ac1-9020f816246e tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:01.919486 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-6d7382f1-8b75-4ca2-9ac1-9020f816246e tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1363 microversion: 2.1 time: 0.152131 Sep 30 19:30:01.920043 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 108/189] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:01 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:30:02.041371 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-2bc32b66-1a9f-41b4-a090-c05a1b29dc4a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:02.041915 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-2bc32b66-1a9f-41b4-a090-c05a1b29dc4a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:02.047693 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2bc32b66-1a9f-41b4-a090-c05a1b29dc4a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:02.048218 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2bc32b66-1a9f-41b4-a090-c05a1b29dc4a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:02.048708 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2bc32b66-1a9f-41b4-a090-c05a1b29dc4a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:02.049396 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2bc32b66-1a9f-41b4-a090-c05a1b29dc4a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:02.049854 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2bc32b66-1a9f-41b4-a090-c05a1b29dc4a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:02.050282 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2bc32b66-1a9f-41b4-a090-c05a1b29dc4a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:02.183238 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-2bc32b66-1a9f-41b4-a090-c05a1b29dc4a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:02.192204 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-2bc32b66-1a9f-41b4-a090-c05a1b29dc4a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:02.193698 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-2bc32b66-1a9f-41b4-a090-c05a1b29dc4a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:02.194833 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-2bc32b66-1a9f-41b4-a090-c05a1b29dc4a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1406 microversion: 2.20 time: 0.157425 Sep 30 19:30:02.195389 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 82/190] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:30:02 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:30:02.283898 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-adec632d-38a7-4b3c-af57-6711e14a61e4 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:02.285355 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-adec632d-38a7-4b3c-af57-6711e14a61e4 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:02.291328 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-adec632d-38a7-4b3c-af57-6711e14a61e4 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:02.291865 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-adec632d-38a7-4b3c-af57-6711e14a61e4 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:02.292242 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-adec632d-38a7-4b3c-af57-6711e14a61e4 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:02.292965 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-adec632d-38a7-4b3c-af57-6711e14a61e4 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:02.293439 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-adec632d-38a7-4b3c-af57-6711e14a61e4 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:02.293861 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-adec632d-38a7-4b3c-af57-6711e14a61e4 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:02.421299 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-adec632d-38a7-4b3c-af57-6711e14a61e4 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:02.429454 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-adec632d-38a7-4b3c-af57-6711e14a61e4 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d" status: 200 len: 1366 microversion: 2.1 time: 0.149515 Sep 30 19:30:02.430022 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 109/191] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:02 2022] GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:30:02.463064 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-a42137ae-323f-4080-b159-f12c379b3f1b tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:02.463664 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-a42137ae-323f-4080-b159-f12c379b3f1b tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:02.469761 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a42137ae-323f-4080-b159-f12c379b3f1b tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:02.470281 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a42137ae-323f-4080-b159-f12c379b3f1b tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:02.470756 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a42137ae-323f-4080-b159-f12c379b3f1b tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:02.471473 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a42137ae-323f-4080-b159-f12c379b3f1b tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:02.471961 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a42137ae-323f-4080-b159-f12c379b3f1b tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:02.473132 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a42137ae-323f-4080-b159-f12c379b3f1b tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:02.656602 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-a42137ae-323f-4080-b159-f12c379b3f1b tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:02.665840 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-a42137ae-323f-4080-b159-f12c379b3f1b tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1322 microversion: 2.1 time: 0.206271 Sep 30 19:30:02.666606 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 83/192] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:02 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:30:02.942698 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-eaba9c41-9b6f-4297-809b-4a413612dc5d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:02.943297 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-eaba9c41-9b6f-4297-809b-4a413612dc5d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:02.949288 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-eaba9c41-9b6f-4297-809b-4a413612dc5d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:02.949765 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-eaba9c41-9b6f-4297-809b-4a413612dc5d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:02.950201 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-eaba9c41-9b6f-4297-809b-4a413612dc5d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:02.950989 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-eaba9c41-9b6f-4297-809b-4a413612dc5d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:02.951530 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-eaba9c41-9b6f-4297-809b-4a413612dc5d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:02.951953 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-eaba9c41-9b6f-4297-809b-4a413612dc5d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:03.078408 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-eaba9c41-9b6f-4297-809b-4a413612dc5d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:03.086602 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-eaba9c41-9b6f-4297-809b-4a413612dc5d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1363 microversion: 2.1 time: 0.147782 Sep 30 19:30:03.087159 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 110/193] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:02 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:30:03.224049 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-35f8a117-608c-4791-a2af-1905a43a71db tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:03.224734 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-35f8a117-608c-4791-a2af-1905a43a71db tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:03.230687 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-35f8a117-608c-4791-a2af-1905a43a71db tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:03.231169 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-35f8a117-608c-4791-a2af-1905a43a71db tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:03.231603 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-35f8a117-608c-4791-a2af-1905a43a71db tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:03.232313 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-35f8a117-608c-4791-a2af-1905a43a71db tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:03.232793 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-35f8a117-608c-4791-a2af-1905a43a71db tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:03.233217 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-35f8a117-608c-4791-a2af-1905a43a71db tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:03.357234 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-35f8a117-608c-4791-a2af-1905a43a71db tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:03.365837 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-35f8a117-608c-4791-a2af-1905a43a71db tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:03.367312 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-35f8a117-608c-4791-a2af-1905a43a71db tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:03.368427 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-35f8a117-608c-4791-a2af-1905a43a71db tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1406 microversion: 2.20 time: 0.151842 Sep 30 19:30:03.369000 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 84/194] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:30:03 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:30:03.451645 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-5f329559-34cb-44ff-8111-e460da29272b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:03.452338 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-5f329559-34cb-44ff-8111-e460da29272b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:03.458665 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5f329559-34cb-44ff-8111-e460da29272b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:03.459143 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5f329559-34cb-44ff-8111-e460da29272b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:03.459576 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5f329559-34cb-44ff-8111-e460da29272b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:03.460256 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5f329559-34cb-44ff-8111-e460da29272b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:03.460746 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5f329559-34cb-44ff-8111-e460da29272b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:03.461156 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5f329559-34cb-44ff-8111-e460da29272b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:03.589207 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-5f329559-34cb-44ff-8111-e460da29272b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:03.596633 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-5f329559-34cb-44ff-8111-e460da29272b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d" status: 200 len: 1366 microversion: 2.1 time: 0.148815 Sep 30 19:30:03.597199 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 111/195] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:03 2022] GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:30:03.687717 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-3ce3d464-2dbe-4dd8-8031-d2d5dadcafe9 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:03.688330 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-3ce3d464-2dbe-4dd8-8031-d2d5dadcafe9 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:03.694755 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3ce3d464-2dbe-4dd8-8031-d2d5dadcafe9 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:03.695238 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3ce3d464-2dbe-4dd8-8031-d2d5dadcafe9 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:03.695674 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3ce3d464-2dbe-4dd8-8031-d2d5dadcafe9 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:03.696357 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3ce3d464-2dbe-4dd8-8031-d2d5dadcafe9 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:03.696839 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3ce3d464-2dbe-4dd8-8031-d2d5dadcafe9 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:03.697293 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3ce3d464-2dbe-4dd8-8031-d2d5dadcafe9 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:03.822240 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-3ce3d464-2dbe-4dd8-8031-d2d5dadcafe9 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:03.829762 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-3ce3d464-2dbe-4dd8-8031-d2d5dadcafe9 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1322 microversion: 2.1 time: 0.145842 Sep 30 19:30:03.830327 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 85/196] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:03 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:30:04.109386 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-186af51f-fb5a-4eb9-826b-b9af4a98c4ed tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:04.109988 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-186af51f-fb5a-4eb9-826b-b9af4a98c4ed tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:04.115826 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-186af51f-fb5a-4eb9-826b-b9af4a98c4ed tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:04.116305 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-186af51f-fb5a-4eb9-826b-b9af4a98c4ed tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:04.116765 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-186af51f-fb5a-4eb9-826b-b9af4a98c4ed tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:04.117446 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-186af51f-fb5a-4eb9-826b-b9af4a98c4ed tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:04.117893 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-186af51f-fb5a-4eb9-826b-b9af4a98c4ed tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:04.118309 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-186af51f-fb5a-4eb9-826b-b9af4a98c4ed tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:04.245992 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-186af51f-fb5a-4eb9-826b-b9af4a98c4ed tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:04.254421 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-186af51f-fb5a-4eb9-826b-b9af4a98c4ed tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1363 microversion: 2.1 time: 0.148157 Sep 30 19:30:04.254896 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 112/197] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:04 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:30:04.394142 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-c9c0445d-c668-4d34-917c-4bd1662eefd9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:04.394917 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-c9c0445d-c668-4d34-917c-4bd1662eefd9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:04.403530 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c9c0445d-c668-4d34-917c-4bd1662eefd9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:04.405001 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c9c0445d-c668-4d34-917c-4bd1662eefd9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:04.405514 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c9c0445d-c668-4d34-917c-4bd1662eefd9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:04.406747 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c9c0445d-c668-4d34-917c-4bd1662eefd9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:04.406747 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c9c0445d-c668-4d34-917c-4bd1662eefd9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:04.407111 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c9c0445d-c668-4d34-917c-4bd1662eefd9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:04.533221 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-c9c0445d-c668-4d34-917c-4bd1662eefd9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:04.542000 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-c9c0445d-c668-4d34-917c-4bd1662eefd9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:04.543431 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-c9c0445d-c668-4d34-917c-4bd1662eefd9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:04.544554 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-c9c0445d-c668-4d34-917c-4bd1662eefd9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1406 microversion: 2.20 time: 0.154664 Sep 30 19:30:04.545122 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 86/198] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:30:04 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:30:04.619928 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-a4ff6928-5612-46ee-9cbd-4345b800adcd tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:04.620477 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-a4ff6928-5612-46ee-9cbd-4345b800adcd tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:04.626324 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a4ff6928-5612-46ee-9cbd-4345b800adcd tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:04.626796 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a4ff6928-5612-46ee-9cbd-4345b800adcd tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:04.627220 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a4ff6928-5612-46ee-9cbd-4345b800adcd tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:04.627890 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a4ff6928-5612-46ee-9cbd-4345b800adcd tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:04.628335 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a4ff6928-5612-46ee-9cbd-4345b800adcd tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:04.628773 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a4ff6928-5612-46ee-9cbd-4345b800adcd tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:04.646257 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=100 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:04.757938 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-a4ff6928-5612-46ee-9cbd-4345b800adcd tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:04.765487 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-a4ff6928-5612-46ee-9cbd-4345b800adcd tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d" status: 200 len: 1366 microversion: 2.1 time: 0.149525 Sep 30 19:30:04.766053 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 113/199] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:04 2022] GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:30:04.853395 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-7f17e166-0308-4a91-bfca-0811bd2ccebe tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:04.854000 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-7f17e166-0308-4a91-bfca-0811bd2ccebe tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:04.860016 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7f17e166-0308-4a91-bfca-0811bd2ccebe tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:04.860536 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7f17e166-0308-4a91-bfca-0811bd2ccebe tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:04.860972 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7f17e166-0308-4a91-bfca-0811bd2ccebe tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:04.861690 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7f17e166-0308-4a91-bfca-0811bd2ccebe tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:04.862181 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7f17e166-0308-4a91-bfca-0811bd2ccebe tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:04.862620 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7f17e166-0308-4a91-bfca-0811bd2ccebe tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:04.988576 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-7f17e166-0308-4a91-bfca-0811bd2ccebe tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:04.996047 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-7f17e166-0308-4a91-bfca-0811bd2ccebe tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1322 microversion: 2.1 time: 0.146574 Sep 30 19:30:04.996641 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 87/200] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:04 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:30:05.277352 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-ee81a8e8-23a1-4658-b551-c1f0defe9aca tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:05.277919 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-ee81a8e8-23a1-4658-b551-c1f0defe9aca tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:05.283953 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ee81a8e8-23a1-4658-b551-c1f0defe9aca tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:05.284780 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ee81a8e8-23a1-4658-b551-c1f0defe9aca tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:05.285192 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ee81a8e8-23a1-4658-b551-c1f0defe9aca tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:05.285878 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ee81a8e8-23a1-4658-b551-c1f0defe9aca tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:05.286354 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ee81a8e8-23a1-4658-b551-c1f0defe9aca tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:05.286773 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ee81a8e8-23a1-4658-b551-c1f0defe9aca tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:05.416066 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-ee81a8e8-23a1-4658-b551-c1f0defe9aca tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:05.423631 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-ee81a8e8-23a1-4658-b551-c1f0defe9aca tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1363 microversion: 2.1 time: 0.150051 Sep 30 19:30:05.424173 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 114/201] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:05 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:30:05.569349 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-56cb2538-89fd-49ba-928e-0591fc122cc6 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:05.570026 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-56cb2538-89fd-49ba-928e-0591fc122cc6 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:05.576196 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-56cb2538-89fd-49ba-928e-0591fc122cc6 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:05.576985 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-56cb2538-89fd-49ba-928e-0591fc122cc6 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:05.577424 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-56cb2538-89fd-49ba-928e-0591fc122cc6 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:05.578116 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-56cb2538-89fd-49ba-928e-0591fc122cc6 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:05.578586 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-56cb2538-89fd-49ba-928e-0591fc122cc6 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:05.579004 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-56cb2538-89fd-49ba-928e-0591fc122cc6 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:05.708072 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-56cb2538-89fd-49ba-928e-0591fc122cc6 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:05.716485 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-56cb2538-89fd-49ba-928e-0591fc122cc6 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:05.718022 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-56cb2538-89fd-49ba-928e-0591fc122cc6 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:05.719143 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-56cb2538-89fd-49ba-928e-0591fc122cc6 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1406 microversion: 2.20 time: 0.153682 Sep 30 19:30:05.719687 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 88/202] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:30:05 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:30:05.788620 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-1cc6e8ac-af81-4840-b7c9-9498626940be tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:05.789219 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-1cc6e8ac-af81-4840-b7c9-9498626940be tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:05.795029 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1cc6e8ac-af81-4840-b7c9-9498626940be tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:05.795504 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1cc6e8ac-af81-4840-b7c9-9498626940be tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:05.795935 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1cc6e8ac-af81-4840-b7c9-9498626940be tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:05.796741 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1cc6e8ac-af81-4840-b7c9-9498626940be tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:05.797191 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1cc6e8ac-af81-4840-b7c9-9498626940be tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:05.797609 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1cc6e8ac-af81-4840-b7c9-9498626940be tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:05.921664 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-1cc6e8ac-af81-4840-b7c9-9498626940be tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:05.929683 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-1cc6e8ac-af81-4840-b7c9-9498626940be tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d" status: 200 len: 1366 microversion: 2.1 time: 0.144877 Sep 30 19:30:05.930247 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 115/203] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:05 2022] GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:30:06.019742 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-2b28ecf5-b6a2-47cd-ab89-26cfbedddac3 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:06.020720 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-2b28ecf5-b6a2-47cd-ab89-26cfbedddac3 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:06.026816 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2b28ecf5-b6a2-47cd-ab89-26cfbedddac3 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:06.027306 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2b28ecf5-b6a2-47cd-ab89-26cfbedddac3 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:06.027745 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2b28ecf5-b6a2-47cd-ab89-26cfbedddac3 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:06.028457 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2b28ecf5-b6a2-47cd-ab89-26cfbedddac3 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:06.028918 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2b28ecf5-b6a2-47cd-ab89-26cfbedddac3 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:06.029367 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2b28ecf5-b6a2-47cd-ab89-26cfbedddac3 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:06.155032 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-2b28ecf5-b6a2-47cd-ab89-26cfbedddac3 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:06.162761 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-2b28ecf5-b6a2-47cd-ab89-26cfbedddac3 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1322 microversion: 2.1 time: 0.147557 Sep 30 19:30:06.163384 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 89/204] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:06 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:30:06.380429 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-7a92c5bf-2ac5-4722-8d27-523d36119d9a tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd1025e1-1add-49d1-8906-e2f7bb244d72"}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:30:06.382844 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-7a92c5bf-2ac5-4722-8d27-523d36119d9a tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] [instance: 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:06.388915 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7a92c5bf-2ac5-4722-8d27-523d36119d9a tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:06.389398 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7a92c5bf-2ac5-4722-8d27-523d36119d9a tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:06.389833 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7a92c5bf-2ac5-4722-8d27-523d36119d9a tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:06.390524 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7a92c5bf-2ac5-4722-8d27-523d36119d9a tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:06.390978 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7a92c5bf-2ac5-4722-8d27-523d36119d9a tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:06.391401 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7a92c5bf-2ac5-4722-8d27-523d36119d9a tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:06.447650 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-9939823b-3e75-40df-bb83-d2d2861a2a9a tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:06.448258 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-9939823b-3e75-40df-bb83-d2d2861a2a9a tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:06.454213 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9939823b-3e75-40df-bb83-d2d2861a2a9a tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:06.454609 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9939823b-3e75-40df-bb83-d2d2861a2a9a tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:06.455039 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9939823b-3e75-40df-bb83-d2d2861a2a9a tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:06.455717 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9939823b-3e75-40df-bb83-d2d2861a2a9a tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:06.456214 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9939823b-3e75-40df-bb83-d2d2861a2a9a tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:06.456771 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9939823b-3e75-40df-bb83-d2d2861a2a9a tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:06.586488 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-9939823b-3e75-40df-bb83-d2d2861a2a9a tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:06.594215 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-9939823b-3e75-40df-bb83-d2d2861a2a9a tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1363 microversion: 2.1 time: 0.150460 Sep 30 19:30:06.594782 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 90/205] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:06 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:30:06.745269 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-4c088a6e-751a-44fb-8285-5ca80a59dd5f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:06.745784 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-4c088a6e-751a-44fb-8285-5ca80a59dd5f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:06.751709 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4c088a6e-751a-44fb-8285-5ca80a59dd5f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:06.752266 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4c088a6e-751a-44fb-8285-5ca80a59dd5f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:06.752666 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4c088a6e-751a-44fb-8285-5ca80a59dd5f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:06.753571 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4c088a6e-751a-44fb-8285-5ca80a59dd5f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:06.754081 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4c088a6e-751a-44fb-8285-5ca80a59dd5f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:06.754640 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4c088a6e-751a-44fb-8285-5ca80a59dd5f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:06.882715 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-4c088a6e-751a-44fb-8285-5ca80a59dd5f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:06.890724 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-4c088a6e-751a-44fb-8285-5ca80a59dd5f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:06.892155 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-4c088a6e-751a-44fb-8285-5ca80a59dd5f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:06.893274 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-4c088a6e-751a-44fb-8285-5ca80a59dd5f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1406 microversion: 2.20 time: 0.152062 Sep 30 19:30:06.893825 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 91/206] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:30:06 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:30:06.951164 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-14e268a1-be87-4f3d-8130-abfb9caf61dc tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:06.951763 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-14e268a1-be87-4f3d-8130-abfb9caf61dc tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:06.957876 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-14e268a1-be87-4f3d-8130-abfb9caf61dc tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:06.958352 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-14e268a1-be87-4f3d-8130-abfb9caf61dc tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:06.958785 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-14e268a1-be87-4f3d-8130-abfb9caf61dc tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:06.959463 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-14e268a1-be87-4f3d-8130-abfb9caf61dc tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:06.959913 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-14e268a1-be87-4f3d-8130-abfb9caf61dc tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:06.960335 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-14e268a1-be87-4f3d-8130-abfb9caf61dc tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:07.087151 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-14e268a1-be87-4f3d-8130-abfb9caf61dc tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:07.094616 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-14e268a1-be87-4f3d-8130-abfb9caf61dc tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d" status: 200 len: 1366 microversion: 2.1 time: 0.146977 Sep 30 19:30:07.095172 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 92/207] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:06 2022] GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:30:07.185983 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-249bb1b3-1ef0-4fd9-ab6b-d80873a71c3f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:07.186583 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-249bb1b3-1ef0-4fd9-ab6b-d80873a71c3f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:07.193006 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-249bb1b3-1ef0-4fd9-ab6b-d80873a71c3f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:07.193480 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-249bb1b3-1ef0-4fd9-ab6b-d80873a71c3f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:07.193910 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-249bb1b3-1ef0-4fd9-ab6b-d80873a71c3f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:07.194584 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-249bb1b3-1ef0-4fd9-ab6b-d80873a71c3f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:07.195030 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-249bb1b3-1ef0-4fd9-ab6b-d80873a71c3f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:07.195464 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-249bb1b3-1ef0-4fd9-ab6b-d80873a71c3f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:07.325760 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-249bb1b3-1ef0-4fd9-ab6b-d80873a71c3f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:07.333327 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-249bb1b3-1ef0-4fd9-ab6b-d80873a71c3f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1322 microversion: 2.1 time: 0.151043 Sep 30 19:30:07.333885 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 93/208] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:07 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:30:07.617778 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-3a75c3be-3793-4a0b-9012-493eed494f12 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:07.618361 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-3a75c3be-3793-4a0b-9012-493eed494f12 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:07.624334 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3a75c3be-3793-4a0b-9012-493eed494f12 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:07.624841 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3a75c3be-3793-4a0b-9012-493eed494f12 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:07.625275 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3a75c3be-3793-4a0b-9012-493eed494f12 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:07.625963 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3a75c3be-3793-4a0b-9012-493eed494f12 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:07.626416 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3a75c3be-3793-4a0b-9012-493eed494f12 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:07.626838 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3a75c3be-3793-4a0b-9012-493eed494f12 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:07.755106 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-3a75c3be-3793-4a0b-9012-493eed494f12 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:07.762619 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-3a75c3be-3793-4a0b-9012-493eed494f12 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1363 microversion: 2.1 time: 0.148765 Sep 30 19:30:07.763339 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 94/209] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:07 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:30:07.918318 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-442a8221-be06-41d9-946e-54644615ad99 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:07.918852 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-442a8221-be06-41d9-946e-54644615ad99 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:07.924659 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-442a8221-be06-41d9-946e-54644615ad99 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:07.925164 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-442a8221-be06-41d9-946e-54644615ad99 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:07.925590 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-442a8221-be06-41d9-946e-54644615ad99 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:07.926260 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-442a8221-be06-41d9-946e-54644615ad99 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:07.926706 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-442a8221-be06-41d9-946e-54644615ad99 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:07.927120 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-442a8221-be06-41d9-946e-54644615ad99 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:08.058528 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-442a8221-be06-41d9-946e-54644615ad99 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:08.068456 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-442a8221-be06-41d9-946e-54644615ad99 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:08.070663 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-442a8221-be06-41d9-946e-54644615ad99 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:08.071882 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-442a8221-be06-41d9-946e-54644615ad99 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1406 microversion: 2.20 time: 0.157362 Sep 30 19:30:08.072560 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 95/210] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:30:07 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:30:08.117789 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-9a3b381d-0f89-4d6a-83e1-b10c0e81a22d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:08.118392 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-9a3b381d-0f89-4d6a-83e1-b10c0e81a22d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:08.124292 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9a3b381d-0f89-4d6a-83e1-b10c0e81a22d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:08.124804 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9a3b381d-0f89-4d6a-83e1-b10c0e81a22d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:08.125232 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9a3b381d-0f89-4d6a-83e1-b10c0e81a22d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:08.125912 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9a3b381d-0f89-4d6a-83e1-b10c0e81a22d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:08.126364 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9a3b381d-0f89-4d6a-83e1-b10c0e81a22d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:08.126785 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9a3b381d-0f89-4d6a-83e1-b10c0e81a22d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:08.262268 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-9a3b381d-0f89-4d6a-83e1-b10c0e81a22d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:08.270389 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-9a3b381d-0f89-4d6a-83e1-b10c0e81a22d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d" status: 200 len: 1366 microversion: 2.1 time: 0.156412 Sep 30 19:30:08.270946 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 96/211] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:08 2022] GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:30:08.356204 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-f9af2508-f034-471e-a97f-a149f4550342 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:08.356840 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-f9af2508-f034-471e-a97f-a149f4550342 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:08.362669 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f9af2508-f034-471e-a97f-a149f4550342 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:08.363177 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f9af2508-f034-471e-a97f-a149f4550342 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:08.363604 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f9af2508-f034-471e-a97f-a149f4550342 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:08.364279 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f9af2508-f034-471e-a97f-a149f4550342 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:08.364750 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f9af2508-f034-471e-a97f-a149f4550342 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:08.365170 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f9af2508-f034-471e-a97f-a149f4550342 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:08.499933 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-f9af2508-f034-471e-a97f-a149f4550342 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:08.504167 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell1:SELECT=100 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:08.509406 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-f9af2508-f034-471e-a97f-a149f4550342 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1322 microversion: 2.1 time: 0.157139 Sep 30 19:30:08.510008 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 97/212] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:08 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:30:08.786430 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-2f79b038-0328-4d32-a3e5-a60a9256bca4 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:08.787046 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-2f79b038-0328-4d32-a3e5-a60a9256bca4 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:08.792725 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2f79b038-0328-4d32-a3e5-a60a9256bca4 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:08.793207 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2f79b038-0328-4d32-a3e5-a60a9256bca4 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:08.793638 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2f79b038-0328-4d32-a3e5-a60a9256bca4 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:08.794314 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2f79b038-0328-4d32-a3e5-a60a9256bca4 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:08.794765 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2f79b038-0328-4d32-a3e5-a60a9256bca4 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:08.795186 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2f79b038-0328-4d32-a3e5-a60a9256bca4 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:08.924875 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-2f79b038-0328-4d32-a3e5-a60a9256bca4 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:08.933074 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-2f79b038-0328-4d32-a3e5-a60a9256bca4 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1363 microversion: 2.1 time: 0.151150 Sep 30 19:30:08.933629 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 98/213] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:08 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:30:09.098157 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-e4d32b51-dcf6-4ad4-9028-75e06405e05e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:09.098678 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-e4d32b51-dcf6-4ad4-9028-75e06405e05e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:09.104597 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e4d32b51-dcf6-4ad4-9028-75e06405e05e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:09.105076 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e4d32b51-dcf6-4ad4-9028-75e06405e05e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:09.105515 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e4d32b51-dcf6-4ad4-9028-75e06405e05e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:09.106186 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e4d32b51-dcf6-4ad4-9028-75e06405e05e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:09.106634 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e4d32b51-dcf6-4ad4-9028-75e06405e05e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:09.107054 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e4d32b51-dcf6-4ad4-9028-75e06405e05e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:09.234865 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-e4d32b51-dcf6-4ad4-9028-75e06405e05e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:09.242882 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-e4d32b51-dcf6-4ad4-9028-75e06405e05e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:09.244318 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-e4d32b51-dcf6-4ad4-9028-75e06405e05e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:09.245457 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-e4d32b51-dcf6-4ad4-9028-75e06405e05e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1406 microversion: 2.20 time: 0.151725 Sep 30 19:30:09.246005 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 99/214] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:30:09 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:30:09.292685 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-03b92cf7-fb1d-4e8c-9568-fa001b4e535c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:09.293339 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-03b92cf7-fb1d-4e8c-9568-fa001b4e535c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:09.299024 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-03b92cf7-fb1d-4e8c-9568-fa001b4e535c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:09.299509 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-03b92cf7-fb1d-4e8c-9568-fa001b4e535c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:09.299945 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-03b92cf7-fb1d-4e8c-9568-fa001b4e535c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:09.300655 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-03b92cf7-fb1d-4e8c-9568-fa001b4e535c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:09.301107 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-03b92cf7-fb1d-4e8c-9568-fa001b4e535c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:09.301529 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-03b92cf7-fb1d-4e8c-9568-fa001b4e535c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:09.436607 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-03b92cf7-fb1d-4e8c-9568-fa001b4e535c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:09.444780 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-03b92cf7-fb1d-4e8c-9568-fa001b4e535c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d" status: 200 len: 1366 microversion: 2.1 time: 0.155442 Sep 30 19:30:09.445374 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 100/215] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:09 2022] GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:30:09.532260 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-d1fbebb1-88b4-4b9a-86e2-e97c3777f2a6 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:09.532885 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-d1fbebb1-88b4-4b9a-86e2-e97c3777f2a6 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:09.539587 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d1fbebb1-88b4-4b9a-86e2-e97c3777f2a6 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:09.540060 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d1fbebb1-88b4-4b9a-86e2-e97c3777f2a6 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:09.540519 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d1fbebb1-88b4-4b9a-86e2-e97c3777f2a6 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:09.541195 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d1fbebb1-88b4-4b9a-86e2-e97c3777f2a6 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:09.541642 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d1fbebb1-88b4-4b9a-86e2-e97c3777f2a6 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:09.542057 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d1fbebb1-88b4-4b9a-86e2-e97c3777f2a6 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:09.666158 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-d1fbebb1-88b4-4b9a-86e2-e97c3777f2a6 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:09.673689 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-d1fbebb1-88b4-4b9a-86e2-e97c3777f2a6 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1322 microversion: 2.1 time: 0.145025 Sep 30 19:30:09.674238 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 101/216] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:09 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1322 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:30:09.954832 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-714d322b-d33c-420e-bb64-8f4516308d8b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:09.955471 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-714d322b-d33c-420e-bb64-8f4516308d8b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:09.961826 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-714d322b-d33c-420e-bb64-8f4516308d8b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:09.962375 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-714d322b-d33c-420e-bb64-8f4516308d8b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:09.962808 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-714d322b-d33c-420e-bb64-8f4516308d8b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:09.963490 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-714d322b-d33c-420e-bb64-8f4516308d8b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:09.963937 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-714d322b-d33c-420e-bb64-8f4516308d8b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:09.964359 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-714d322b-d33c-420e-bb64-8f4516308d8b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:10.092450 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-714d322b-d33c-420e-bb64-8f4516308d8b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:10.100627 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-714d322b-d33c-420e-bb64-8f4516308d8b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1363 microversion: 2.1 time: 0.149513 Sep 30 19:30:10.101177 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 102/217] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:09 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:30:10.270245 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-5ef60739-191d-4a52-b8dd-b5f7fe69d78d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:10.270845 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-5ef60739-191d-4a52-b8dd-b5f7fe69d78d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:10.276738 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5ef60739-191d-4a52-b8dd-b5f7fe69d78d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:10.277231 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5ef60739-191d-4a52-b8dd-b5f7fe69d78d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:10.277657 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5ef60739-191d-4a52-b8dd-b5f7fe69d78d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:10.278328 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5ef60739-191d-4a52-b8dd-b5f7fe69d78d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:10.278775 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5ef60739-191d-4a52-b8dd-b5f7fe69d78d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:10.279193 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5ef60739-191d-4a52-b8dd-b5f7fe69d78d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:10.408042 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-5ef60739-191d-4a52-b8dd-b5f7fe69d78d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:10.416440 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-5ef60739-191d-4a52-b8dd-b5f7fe69d78d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:10.417902 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-5ef60739-191d-4a52-b8dd-b5f7fe69d78d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:10.418991 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-5ef60739-191d-4a52-b8dd-b5f7fe69d78d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1406 microversion: 2.20 time: 0.153142 Sep 30 19:30:10.419577 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 103/218] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:30:10 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:30:10.468383 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-4f7aa0b9-aaee-4238-8c46-242c3f7066d7 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:10.468994 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-4f7aa0b9-aaee-4238-8c46-242c3f7066d7 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:10.474829 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4f7aa0b9-aaee-4238-8c46-242c3f7066d7 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:10.475307 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4f7aa0b9-aaee-4238-8c46-242c3f7066d7 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:10.475741 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4f7aa0b9-aaee-4238-8c46-242c3f7066d7 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:10.476449 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4f7aa0b9-aaee-4238-8c46-242c3f7066d7 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:10.476899 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4f7aa0b9-aaee-4238-8c46-242c3f7066d7 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:10.477316 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4f7aa0b9-aaee-4238-8c46-242c3f7066d7 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:10.606940 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-4f7aa0b9-aaee-4238-8c46-242c3f7066d7 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:10.614487 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-4f7aa0b9-aaee-4238-8c46-242c3f7066d7 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d" status: 200 len: 1366 microversion: 2.1 time: 0.149980 Sep 30 19:30:10.615048 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 104/219] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:10 2022] GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:30:10.695839 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-a127fafb-1863-44a5-9338-c1af7092c1c5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:10.696466 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-a127fafb-1863-44a5-9338-c1af7092c1c5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:10.702289 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a127fafb-1863-44a5-9338-c1af7092c1c5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:10.702770 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a127fafb-1863-44a5-9338-c1af7092c1c5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:10.703205 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a127fafb-1863-44a5-9338-c1af7092c1c5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:10.703887 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a127fafb-1863-44a5-9338-c1af7092c1c5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:10.704347 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a127fafb-1863-44a5-9338-c1af7092c1c5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:10.704790 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a127fafb-1863-44a5-9338-c1af7092c1c5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:10.996766 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-a127fafb-1863-44a5-9338-c1af7092c1c5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:11.004381 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-a127fafb-1863-44a5-9338-c1af7092c1c5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1322 microversion: 2.1 time: 0.312161 Sep 30 19:30:11.004977 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 105/220] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:10 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1322 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:30:11.123087 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-d28fd94c-be58-493f-af6e-de2c7745d8ed tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:11.123691 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-d28fd94c-be58-493f-af6e-de2c7745d8ed tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:11.130333 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d28fd94c-be58-493f-af6e-de2c7745d8ed tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:11.130819 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d28fd94c-be58-493f-af6e-de2c7745d8ed tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:11.131249 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d28fd94c-be58-493f-af6e-de2c7745d8ed tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:11.131935 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d28fd94c-be58-493f-af6e-de2c7745d8ed tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:11.132460 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d28fd94c-be58-493f-af6e-de2c7745d8ed tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:11.132858 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d28fd94c-be58-493f-af6e-de2c7745d8ed tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:11.260218 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-d28fd94c-be58-493f-af6e-de2c7745d8ed tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:11.267745 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-d28fd94c-be58-493f-af6e-de2c7745d8ed tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1363 microversion: 2.1 time: 0.148514 Sep 30 19:30:11.268304 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 106/221] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:11 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:30:11.443037 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-ccc9ce2d-7b41-426d-b426-a7806cb68726 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:11.443642 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-ccc9ce2d-7b41-426d-b426-a7806cb68726 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:11.449563 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ccc9ce2d-7b41-426d-b426-a7806cb68726 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:11.450044 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ccc9ce2d-7b41-426d-b426-a7806cb68726 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:11.450478 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ccc9ce2d-7b41-426d-b426-a7806cb68726 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:11.451162 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ccc9ce2d-7b41-426d-b426-a7806cb68726 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:11.451613 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ccc9ce2d-7b41-426d-b426-a7806cb68726 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:11.452033 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ccc9ce2d-7b41-426d-b426-a7806cb68726 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:11.581679 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-ccc9ce2d-7b41-426d-b426-a7806cb68726 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:11.589699 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-ccc9ce2d-7b41-426d-b426-a7806cb68726 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:11.591148 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-ccc9ce2d-7b41-426d-b426-a7806cb68726 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:11.592252 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-ccc9ce2d-7b41-426d-b426-a7806cb68726 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1406 microversion: 2.20 time: 0.153160 Sep 30 19:30:11.592837 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 107/222] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:30:11 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:30:11.637153 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-11fa01be-0ea2-4e45-a7ba-03edbdc5cd44 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:11.637762 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-11fa01be-0ea2-4e45-a7ba-03edbdc5cd44 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:11.643533 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-11fa01be-0ea2-4e45-a7ba-03edbdc5cd44 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:11.644559 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-11fa01be-0ea2-4e45-a7ba-03edbdc5cd44 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:11.644993 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-11fa01be-0ea2-4e45-a7ba-03edbdc5cd44 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:11.645676 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-11fa01be-0ea2-4e45-a7ba-03edbdc5cd44 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:11.646135 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-11fa01be-0ea2-4e45-a7ba-03edbdc5cd44 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:11.646577 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-11fa01be-0ea2-4e45-a7ba-03edbdc5cd44 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:11.781158 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-11fa01be-0ea2-4e45-a7ba-03edbdc5cd44 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:11.789295 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-11fa01be-0ea2-4e45-a7ba-03edbdc5cd44 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d" status: 200 len: 1366 microversion: 2.1 time: 0.155738 Sep 30 19:30:11.789856 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 108/223] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:11 2022] GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:30:11.920503 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [req-b6be2c2a-02e2-4f9a-b3d6-09a6f297be21 req-0b03e472-5bb1-4316-b08c-0e898d4cb87d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a84ee4e3-e6e4-4574-810f-8e5e796b4c4d", "name": "network-vif-plugged", "status": "completed", "tag": "703c0c85-a09a-452a-a548-87d9d670da7d"}]} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:30:11.931865 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-b6be2c2a-02e2-4f9a-b3d6-09a6f297be21 req-0b03e472-5bb1-4316-b08c-0e898d4cb87d service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:11.932345 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-b6be2c2a-02e2-4f9a-b3d6-09a6f297be21 req-0b03e472-5bb1-4316-b08c-0e898d4cb87d service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:11.932792 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-b6be2c2a-02e2-4f9a-b3d6-09a6f297be21 req-0b03e472-5bb1-4316-b08c-0e898d4cb87d service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:11.944358 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.compute.server_external_events [req-b6be2c2a-02e2-4f9a-b3d6-09a6f297be21 req-0b03e472-5bb1-4316-b08c-0e898d4cb87d service nova] Creating event network-vif-plugged:703c0c85-a09a-452a-a548-87d9d670da7d for instance a84ee4e3-e6e4-4574-810f-8e5e796b4c4d on hv-cinder-86001 Sep 30 19:30:11.950181 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [req-b6be2c2a-02e2-4f9a-b3d6-09a6f297be21 req-0b03e472-5bb1-4316-b08c-0e898d4cb87d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033579 Sep 30 19:30:11.950805 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 109/224] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 30 19:30:12.028813 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-68ae006a-7ab2-4ab8-beea-5378ab1c6d9b tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:12.029501 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-68ae006a-7ab2-4ab8-beea-5378ab1c6d9b tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:12.036381 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-68ae006a-7ab2-4ab8-beea-5378ab1c6d9b tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:12.036911 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-68ae006a-7ab2-4ab8-beea-5378ab1c6d9b tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:12.037420 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-68ae006a-7ab2-4ab8-beea-5378ab1c6d9b tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:12.038381 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-68ae006a-7ab2-4ab8-beea-5378ab1c6d9b tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:12.038835 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-68ae006a-7ab2-4ab8-beea-5378ab1c6d9b tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:12.039257 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-68ae006a-7ab2-4ab8-beea-5378ab1c6d9b tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:12.172858 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-68ae006a-7ab2-4ab8-beea-5378ab1c6d9b tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:12.180801 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-68ae006a-7ab2-4ab8-beea-5378ab1c6d9b tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1322 microversion: 2.1 time: 0.156274 Sep 30 19:30:12.181353 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 110/225] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:12 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:30:12.291051 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-d53ba349-42ca-42b6-8815-41f4cbabaf04 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:12.291578 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-d53ba349-42ca-42b6-8815-41f4cbabaf04 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:12.297550 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d53ba349-42ca-42b6-8815-41f4cbabaf04 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:12.298025 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d53ba349-42ca-42b6-8815-41f4cbabaf04 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:12.298452 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d53ba349-42ca-42b6-8815-41f4cbabaf04 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:12.299124 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d53ba349-42ca-42b6-8815-41f4cbabaf04 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:12.299571 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d53ba349-42ca-42b6-8815-41f4cbabaf04 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:12.300526 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d53ba349-42ca-42b6-8815-41f4cbabaf04 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:12.432108 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-d53ba349-42ca-42b6-8815-41f4cbabaf04 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:12.439657 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-d53ba349-42ca-42b6-8815-41f4cbabaf04 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1363 microversion: 2.1 time: 0.152614 Sep 30 19:30:12.440199 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 111/226] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:12 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:30:12.618039 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-a592d761-9a76-4890-b6c0-a3ae8019cd89 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:12.618641 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-a592d761-9a76-4890-b6c0-a3ae8019cd89 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:12.624592 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a592d761-9a76-4890-b6c0-a3ae8019cd89 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:12.625107 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a592d761-9a76-4890-b6c0-a3ae8019cd89 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:12.625541 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a592d761-9a76-4890-b6c0-a3ae8019cd89 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:12.626232 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a592d761-9a76-4890-b6c0-a3ae8019cd89 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:12.626687 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a592d761-9a76-4890-b6c0-a3ae8019cd89 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:12.627112 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a592d761-9a76-4890-b6c0-a3ae8019cd89 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:12.759989 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-a592d761-9a76-4890-b6c0-a3ae8019cd89 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:12.768792 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-a592d761-9a76-4890-b6c0-a3ae8019cd89 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:12.770295 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-a592d761-9a76-4890-b6c0-a3ae8019cd89 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:12.771436 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-a592d761-9a76-4890-b6c0-a3ae8019cd89 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1406 microversion: 2.20 time: 0.157265 Sep 30 19:30:12.772037 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 112/227] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:30:12 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:30:12.812106 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-a61ba6ee-ea0e-4f12-9022-c682240a7c4c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:12.812653 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-a61ba6ee-ea0e-4f12-9022-c682240a7c4c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:12.818350 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a61ba6ee-ea0e-4f12-9022-c682240a7c4c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:12.818862 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a61ba6ee-ea0e-4f12-9022-c682240a7c4c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:12.819300 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a61ba6ee-ea0e-4f12-9022-c682240a7c4c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:12.819984 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a61ba6ee-ea0e-4f12-9022-c682240a7c4c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:12.820464 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a61ba6ee-ea0e-4f12-9022-c682240a7c4c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:12.820898 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a61ba6ee-ea0e-4f12-9022-c682240a7c4c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:12.944394 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-a61ba6ee-ea0e-4f12-9022-c682240a7c4c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:12.952161 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-a61ba6ee-ea0e-4f12-9022-c682240a7c4c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d" status: 200 len: 1366 microversion: 2.1 time: 0.143670 Sep 30 19:30:12.952766 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 113/228] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:12 2022] GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d => generated 1366 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:30:13.203105 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-fb7f4bcd-846c-4325-a443-42747d17ea54 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:13.203734 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-fb7f4bcd-846c-4325-a443-42747d17ea54 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:13.210275 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-fb7f4bcd-846c-4325-a443-42747d17ea54 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:13.210798 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-fb7f4bcd-846c-4325-a443-42747d17ea54 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:13.211196 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-fb7f4bcd-846c-4325-a443-42747d17ea54 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:13.211890 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-fb7f4bcd-846c-4325-a443-42747d17ea54 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:13.212352 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-fb7f4bcd-846c-4325-a443-42747d17ea54 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:13.212800 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-fb7f4bcd-846c-4325-a443-42747d17ea54 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:13.339528 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-fb7f4bcd-846c-4325-a443-42747d17ea54 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:13.347862 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-fb7f4bcd-846c-4325-a443-42747d17ea54 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1322 microversion: 2.1 time: 0.148646 Sep 30 19:30:13.348438 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 114/229] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:13 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:30:13.462493 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-2000d93d-8d5f-41fd-a48f-72be29079e1d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:13.463317 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-2000d93d-8d5f-41fd-a48f-72be29079e1d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:13.469901 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2000d93d-8d5f-41fd-a48f-72be29079e1d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:13.470447 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2000d93d-8d5f-41fd-a48f-72be29079e1d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:13.470946 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2000d93d-8d5f-41fd-a48f-72be29079e1d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:13.472201 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2000d93d-8d5f-41fd-a48f-72be29079e1d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:13.472694 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2000d93d-8d5f-41fd-a48f-72be29079e1d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:13.473114 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2000d93d-8d5f-41fd-a48f-72be29079e1d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:13.479387 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell1:SELECT=100 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:13.642800 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-2000d93d-8d5f-41fd-a48f-72be29079e1d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:13.653035 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-2000d93d-8d5f-41fd-a48f-72be29079e1d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1363 microversion: 2.1 time: 0.192083 Sep 30 19:30:13.664778 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 115/230] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:13 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1363 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:30:13.798310 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-a1e1c120-337e-437f-ba7e-277119c71ea1 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:13.799197 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-a1e1c120-337e-437f-ba7e-277119c71ea1 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:13.807350 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a1e1c120-337e-437f-ba7e-277119c71ea1 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:13.807980 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a1e1c120-337e-437f-ba7e-277119c71ea1 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:13.808849 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a1e1c120-337e-437f-ba7e-277119c71ea1 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:13.809560 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a1e1c120-337e-437f-ba7e-277119c71ea1 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:13.810015 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a1e1c120-337e-437f-ba7e-277119c71ea1 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:13.810442 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a1e1c120-337e-437f-ba7e-277119c71ea1 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:13.943126 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-a1e1c120-337e-437f-ba7e-277119c71ea1 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:13.953891 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-a1e1c120-337e-437f-ba7e-277119c71ea1 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:13.955266 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-a1e1c120-337e-437f-ba7e-277119c71ea1 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:13.957251 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-a1e1c120-337e-437f-ba7e-277119c71ea1 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1406 microversion: 2.20 time: 0.164139 Sep 30 19:30:13.964206 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 116/231] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:30:13 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:30:13.991249 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-020f4064-aa12-4c54-bd1d-8b5e250b1e95 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:13.992618 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-020f4064-aa12-4c54-bd1d-8b5e250b1e95 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:14.003469 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-020f4064-aa12-4c54-bd1d-8b5e250b1e95 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:14.004381 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-020f4064-aa12-4c54-bd1d-8b5e250b1e95 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:14.005025 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-020f4064-aa12-4c54-bd1d-8b5e250b1e95 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:14.006407 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-020f4064-aa12-4c54-bd1d-8b5e250b1e95 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:14.006947 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-020f4064-aa12-4c54-bd1d-8b5e250b1e95 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:14.007472 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-020f4064-aa12-4c54-bd1d-8b5e250b1e95 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:14.224418 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-020f4064-aa12-4c54-bd1d-8b5e250b1e95 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:14.235975 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-020f4064-aa12-4c54-bd1d-8b5e250b1e95 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d" status: 200 len: 1366 microversion: 2.1 time: 0.258120 Sep 30 19:30:14.240542 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 117/232] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:13 2022] GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d => generated 1366 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:30:14.370882 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-773ef6c1-8220-4bd9-ae67-51d4e8be1919 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:14.371793 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-773ef6c1-8220-4bd9-ae67-51d4e8be1919 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:14.379833 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-773ef6c1-8220-4bd9-ae67-51d4e8be1919 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:14.380538 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-773ef6c1-8220-4bd9-ae67-51d4e8be1919 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:14.381243 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-773ef6c1-8220-4bd9-ae67-51d4e8be1919 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:14.382070 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-773ef6c1-8220-4bd9-ae67-51d4e8be1919 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:14.382590 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-773ef6c1-8220-4bd9-ae67-51d4e8be1919 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:14.383169 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-773ef6c1-8220-4bd9-ae67-51d4e8be1919 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:14.532232 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-773ef6c1-8220-4bd9-ae67-51d4e8be1919 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:14.539992 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-773ef6c1-8220-4bd9-ae67-51d4e8be1919 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1322 microversion: 2.1 time: 0.172913 Sep 30 19:30:14.540744 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 118/233] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:14 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:30:14.676664 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-6ad3d2e6-2a9f-41fe-9bac-7e0923b2072f tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:14.677383 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-6ad3d2e6-2a9f-41fe-9bac-7e0923b2072f tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:14.683696 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6ad3d2e6-2a9f-41fe-9bac-7e0923b2072f tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:14.684193 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6ad3d2e6-2a9f-41fe-9bac-7e0923b2072f tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:14.684650 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6ad3d2e6-2a9f-41fe-9bac-7e0923b2072f tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:14.685491 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6ad3d2e6-2a9f-41fe-9bac-7e0923b2072f tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:14.685870 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6ad3d2e6-2a9f-41fe-9bac-7e0923b2072f tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:14.686291 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6ad3d2e6-2a9f-41fe-9bac-7e0923b2072f tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:14.827426 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-6ad3d2e6-2a9f-41fe-9bac-7e0923b2072f tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:14.835651 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-6ad3d2e6-2a9f-41fe-9bac-7e0923b2072f tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1363 microversion: 2.1 time: 0.164962 Sep 30 19:30:14.836214 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 119/234] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:14 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:30:14.986083 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-594a657f-ec39-47be-9cc9-9d9540529e3f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:14.987126 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-594a657f-ec39-47be-9cc9-9d9540529e3f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:14.994095 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-594a657f-ec39-47be-9cc9-9d9540529e3f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:14.994585 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-594a657f-ec39-47be-9cc9-9d9540529e3f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:14.995047 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-594a657f-ec39-47be-9cc9-9d9540529e3f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:14.995753 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-594a657f-ec39-47be-9cc9-9d9540529e3f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:14.996233 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-594a657f-ec39-47be-9cc9-9d9540529e3f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:14.996721 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-594a657f-ec39-47be-9cc9-9d9540529e3f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:15.132271 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-594a657f-ec39-47be-9cc9-9d9540529e3f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:15.141812 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-594a657f-ec39-47be-9cc9-9d9540529e3f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:15.143232 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-594a657f-ec39-47be-9cc9-9d9540529e3f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:15.145027 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-594a657f-ec39-47be-9cc9-9d9540529e3f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1406 microversion: 2.20 time: 0.163479 Sep 30 19:30:15.145578 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 120/235] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:30:14 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:30:15.258912 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-ea578cfb-d827-458f-87e2-36a553ce706b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:15.259562 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-ea578cfb-d827-458f-87e2-36a553ce706b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:15.265368 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ea578cfb-d827-458f-87e2-36a553ce706b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:15.265849 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ea578cfb-d827-458f-87e2-36a553ce706b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:15.266274 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ea578cfb-d827-458f-87e2-36a553ce706b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:15.266969 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ea578cfb-d827-458f-87e2-36a553ce706b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:15.267462 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ea578cfb-d827-458f-87e2-36a553ce706b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:15.267885 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ea578cfb-d827-458f-87e2-36a553ce706b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:15.392386 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-ea578cfb-d827-458f-87e2-36a553ce706b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:15.400471 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-ea578cfb-d827-458f-87e2-36a553ce706b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d" status: 200 len: 1366 microversion: 2.1 time: 0.145397 Sep 30 19:30:15.401027 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 121/236] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:15 2022] GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:30:15.562484 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-1cdf41b2-a018-448d-b6f8-e09d3dcb1bce tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:15.563028 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-1cdf41b2-a018-448d-b6f8-e09d3dcb1bce tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:15.569416 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1cdf41b2-a018-448d-b6f8-e09d3dcb1bce tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:15.569892 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1cdf41b2-a018-448d-b6f8-e09d3dcb1bce tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:15.570325 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1cdf41b2-a018-448d-b6f8-e09d3dcb1bce tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:15.571010 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1cdf41b2-a018-448d-b6f8-e09d3dcb1bce tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:15.571461 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1cdf41b2-a018-448d-b6f8-e09d3dcb1bce tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:15.571919 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1cdf41b2-a018-448d-b6f8-e09d3dcb1bce tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:15.698107 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-1cdf41b2-a018-448d-b6f8-e09d3dcb1bce tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:15.705531 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-1cdf41b2-a018-448d-b6f8-e09d3dcb1bce tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1322 microversion: 2.1 time: 0.146911 Sep 30 19:30:15.706721 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 122/237] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:15 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:30:15.859119 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-657b639b-fc53-4c66-b235-d4727cf80a1a tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:15.859655 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-657b639b-fc53-4c66-b235-d4727cf80a1a tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:15.865757 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-657b639b-fc53-4c66-b235-d4727cf80a1a tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:15.866276 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-657b639b-fc53-4c66-b235-d4727cf80a1a tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:15.866709 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-657b639b-fc53-4c66-b235-d4727cf80a1a tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:15.867433 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-657b639b-fc53-4c66-b235-d4727cf80a1a tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:15.867885 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-657b639b-fc53-4c66-b235-d4727cf80a1a tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:15.868351 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-657b639b-fc53-4c66-b235-d4727cf80a1a tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:16.003809 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-657b639b-fc53-4c66-b235-d4727cf80a1a tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:16.012143 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-657b639b-fc53-4c66-b235-d4727cf80a1a tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1363 microversion: 2.1 time: 0.156924 Sep 30 19:30:16.012745 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 123/238] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:15 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:30:16.170016 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-eb554dd1-ad77-4d45-9907-8c0aafe4572a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:16.170654 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-eb554dd1-ad77-4d45-9907-8c0aafe4572a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:16.177452 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-eb554dd1-ad77-4d45-9907-8c0aafe4572a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:16.178026 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-eb554dd1-ad77-4d45-9907-8c0aafe4572a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:16.178611 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-eb554dd1-ad77-4d45-9907-8c0aafe4572a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:16.179446 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-eb554dd1-ad77-4d45-9907-8c0aafe4572a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:16.180008 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-eb554dd1-ad77-4d45-9907-8c0aafe4572a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:16.180391 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-eb554dd1-ad77-4d45-9907-8c0aafe4572a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:16.322034 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-eb554dd1-ad77-4d45-9907-8c0aafe4572a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:16.329952 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-eb554dd1-ad77-4d45-9907-8c0aafe4572a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:16.331394 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-eb554dd1-ad77-4d45-9907-8c0aafe4572a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:16.332519 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-eb554dd1-ad77-4d45-9907-8c0aafe4572a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1406 microversion: 2.20 time: 0.166508 Sep 30 19:30:16.333078 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 124/239] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:30:16 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:30:16.386809 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=36 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:16.424228 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-3b7e7ddb-8166-4e21-8ee5-935cdf0d5322 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:16.425460 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-3b7e7ddb-8166-4e21-8ee5-935cdf0d5322 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:16.431327 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3b7e7ddb-8166-4e21-8ee5-935cdf0d5322 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:16.431807 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3b7e7ddb-8166-4e21-8ee5-935cdf0d5322 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:16.432238 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3b7e7ddb-8166-4e21-8ee5-935cdf0d5322 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:16.432961 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3b7e7ddb-8166-4e21-8ee5-935cdf0d5322 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:16.433417 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3b7e7ddb-8166-4e21-8ee5-935cdf0d5322 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:16.433842 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3b7e7ddb-8166-4e21-8ee5-935cdf0d5322 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:16.500720 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=20 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:16.562807 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-3b7e7ddb-8166-4e21-8ee5-935cdf0d5322 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:16.570978 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-3b7e7ddb-8166-4e21-8ee5-935cdf0d5322 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d" status: 200 len: 1366 microversion: 2.1 time: 0.150631 Sep 30 19:30:16.571542 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 125/240] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:16 2022] GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:30:16.728987 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-161b2679-1f73-4af1-bc7d-46038734bfe1 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:16.729588 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-161b2679-1f73-4af1-bc7d-46038734bfe1 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:16.732472 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_api:SELECT=100 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:16.736358 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-161b2679-1f73-4af1-bc7d-46038734bfe1 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:16.736858 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-161b2679-1f73-4af1-bc7d-46038734bfe1 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:16.737805 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-161b2679-1f73-4af1-bc7d-46038734bfe1 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:16.738486 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-161b2679-1f73-4af1-bc7d-46038734bfe1 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:16.738934 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-161b2679-1f73-4af1-bc7d-46038734bfe1 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:16.739352 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-161b2679-1f73-4af1-bc7d-46038734bfe1 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:16.865693 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-161b2679-1f73-4af1-bc7d-46038734bfe1 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:16.873190 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-161b2679-1f73-4af1-bc7d-46038734bfe1 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1322 microversion: 2.1 time: 0.148099 Sep 30 19:30:16.873769 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 126/241] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:16 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:30:17.035303 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-b50e9069-8819-49ae-a5c5-834ac8a5643e tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:17.035846 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-b50e9069-8819-49ae-a5c5-834ac8a5643e tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:17.041815 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b50e9069-8819-49ae-a5c5-834ac8a5643e tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:17.042292 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b50e9069-8819-49ae-a5c5-834ac8a5643e tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:17.042720 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b50e9069-8819-49ae-a5c5-834ac8a5643e tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:17.043392 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b50e9069-8819-49ae-a5c5-834ac8a5643e tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:17.043881 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b50e9069-8819-49ae-a5c5-834ac8a5643e tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:17.044306 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b50e9069-8819-49ae-a5c5-834ac8a5643e tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:17.185445 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-b50e9069-8819-49ae-a5c5-834ac8a5643e tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:17.192957 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-b50e9069-8819-49ae-a5c5-834ac8a5643e tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1363 microversion: 2.1 time: 0.161885 Sep 30 19:30:17.193553 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 127/242] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:17 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:30:17.357313 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-aaeea50d-c160-4434-b504-4481ff8e96bf tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:17.357983 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-aaeea50d-c160-4434-b504-4481ff8e96bf tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:17.364949 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-aaeea50d-c160-4434-b504-4481ff8e96bf tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:17.365430 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-aaeea50d-c160-4434-b504-4481ff8e96bf tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:17.365879 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-aaeea50d-c160-4434-b504-4481ff8e96bf tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:17.366563 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-aaeea50d-c160-4434-b504-4481ff8e96bf tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:17.367008 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-aaeea50d-c160-4434-b504-4481ff8e96bf tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:17.367424 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-aaeea50d-c160-4434-b504-4481ff8e96bf tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:17.493425 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-aaeea50d-c160-4434-b504-4481ff8e96bf tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:17.501449 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-aaeea50d-c160-4434-b504-4481ff8e96bf tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:17.502925 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-aaeea50d-c160-4434-b504-4481ff8e96bf tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:17.504333 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-aaeea50d-c160-4434-b504-4481ff8e96bf tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1406 microversion: 2.20 time: 0.150942 Sep 30 19:30:17.505104 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 128/243] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:30:17 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:30:17.593939 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-3c0eced9-f379-4b7c-afcb-55011d500d1e tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:17.594466 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-3c0eced9-f379-4b7c-afcb-55011d500d1e tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:17.601499 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3c0eced9-f379-4b7c-afcb-55011d500d1e tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:17.602047 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3c0eced9-f379-4b7c-afcb-55011d500d1e tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:17.602479 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3c0eced9-f379-4b7c-afcb-55011d500d1e tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:17.603254 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3c0eced9-f379-4b7c-afcb-55011d500d1e tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:17.603703 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3c0eced9-f379-4b7c-afcb-55011d500d1e tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:17.604149 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3c0eced9-f379-4b7c-afcb-55011d500d1e tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:17.733577 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-3c0eced9-f379-4b7c-afcb-55011d500d1e tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:17.742215 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-3c0eced9-f379-4b7c-afcb-55011d500d1e tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d" status: 200 len: 1366 microversion: 2.1 time: 0.152082 Sep 30 19:30:17.742767 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 129/244] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:17 2022] GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:30:17.896653 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-c0389062-83e2-4f46-b762-c98467e0ca7d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:17.897261 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-c0389062-83e2-4f46-b762-c98467e0ca7d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:17.903367 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c0389062-83e2-4f46-b762-c98467e0ca7d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:17.904085 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c0389062-83e2-4f46-b762-c98467e0ca7d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:17.904551 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c0389062-83e2-4f46-b762-c98467e0ca7d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:17.905228 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c0389062-83e2-4f46-b762-c98467e0ca7d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:17.905673 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c0389062-83e2-4f46-b762-c98467e0ca7d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:17.906093 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c0389062-83e2-4f46-b762-c98467e0ca7d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:18.035180 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-c0389062-83e2-4f46-b762-c98467e0ca7d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:18.042612 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-c0389062-83e2-4f46-b762-c98467e0ca7d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1322 microversion: 2.1 time: 0.150581 Sep 30 19:30:18.043171 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 130/245] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:17 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:30:18.215088 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-150b5282-f70a-4426-8a71-92fd09e34b62 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:18.215706 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-150b5282-f70a-4426-8a71-92fd09e34b62 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:18.221916 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-150b5282-f70a-4426-8a71-92fd09e34b62 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:18.222397 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-150b5282-f70a-4426-8a71-92fd09e34b62 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:18.222827 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-150b5282-f70a-4426-8a71-92fd09e34b62 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:18.223638 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-150b5282-f70a-4426-8a71-92fd09e34b62 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:18.224133 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-150b5282-f70a-4426-8a71-92fd09e34b62 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:18.224579 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-150b5282-f70a-4426-8a71-92fd09e34b62 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:18.353169 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-150b5282-f70a-4426-8a71-92fd09e34b62 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:18.356519 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell1:SELECT=100 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:18.362089 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-150b5282-f70a-4426-8a71-92fd09e34b62 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1363 microversion: 2.1 time: 0.151035 Sep 30 19:30:18.363222 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 131/246] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:18 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:30:18.529496 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-6cc51231-37b9-4f34-8331-57a50750840d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:18.530154 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-6cc51231-37b9-4f34-8331-57a50750840d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:18.537023 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6cc51231-37b9-4f34-8331-57a50750840d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:18.537496 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6cc51231-37b9-4f34-8331-57a50750840d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:18.537921 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6cc51231-37b9-4f34-8331-57a50750840d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:18.538601 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6cc51231-37b9-4f34-8331-57a50750840d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:18.539046 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6cc51231-37b9-4f34-8331-57a50750840d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:18.539468 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6cc51231-37b9-4f34-8331-57a50750840d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:18.668068 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-6cc51231-37b9-4f34-8331-57a50750840d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:18.676229 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-6cc51231-37b9-4f34-8331-57a50750840d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:18.677832 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-6cc51231-37b9-4f34-8331-57a50750840d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:18.678999 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-6cc51231-37b9-4f34-8331-57a50750840d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1406 microversion: 2.20 time: 0.153347 Sep 30 19:30:18.679549 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 132/247] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:30:18 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:30:18.763984 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-058ff9b0-10ac-4765-b2d8-0d6fd927882d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:18.764616 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-058ff9b0-10ac-4765-b2d8-0d6fd927882d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:18.771102 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-058ff9b0-10ac-4765-b2d8-0d6fd927882d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:18.771575 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-058ff9b0-10ac-4765-b2d8-0d6fd927882d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:18.772003 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-058ff9b0-10ac-4765-b2d8-0d6fd927882d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:18.772743 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-058ff9b0-10ac-4765-b2d8-0d6fd927882d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:18.773191 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-058ff9b0-10ac-4765-b2d8-0d6fd927882d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:18.773607 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-058ff9b0-10ac-4765-b2d8-0d6fd927882d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:18.898460 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-058ff9b0-10ac-4765-b2d8-0d6fd927882d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:18.906211 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-058ff9b0-10ac-4765-b2d8-0d6fd927882d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d" status: 200 len: 1366 microversion: 2.1 time: 0.146017 Sep 30 19:30:18.906765 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 133/248] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:18 2022] GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:30:19.064942 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-9e0177d6-eab5-4842-a425-2534e4eb692a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:19.066129 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-9e0177d6-eab5-4842-a425-2534e4eb692a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:19.071968 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9e0177d6-eab5-4842-a425-2534e4eb692a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:19.072476 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9e0177d6-eab5-4842-a425-2534e4eb692a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:19.072904 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9e0177d6-eab5-4842-a425-2534e4eb692a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:19.073580 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9e0177d6-eab5-4842-a425-2534e4eb692a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:19.074025 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9e0177d6-eab5-4842-a425-2534e4eb692a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:19.074441 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9e0177d6-eab5-4842-a425-2534e4eb692a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:19.201502 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-9e0177d6-eab5-4842-a425-2534e4eb692a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:19.209040 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-9e0177d6-eab5-4842-a425-2534e4eb692a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1322 microversion: 2.1 time: 0.147901 Sep 30 19:30:19.209585 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 134/249] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:19 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:30:19.386673 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-b8ddfadf-3cbb-41d0-a5e2-6df583f0d9d4 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:19.388894 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-b8ddfadf-3cbb-41d0-a5e2-6df583f0d9d4 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:19.398680 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b8ddfadf-3cbb-41d0-a5e2-6df583f0d9d4 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:19.399329 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b8ddfadf-3cbb-41d0-a5e2-6df583f0d9d4 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:19.399909 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b8ddfadf-3cbb-41d0-a5e2-6df583f0d9d4 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:19.401489 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b8ddfadf-3cbb-41d0-a5e2-6df583f0d9d4 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:19.402181 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b8ddfadf-3cbb-41d0-a5e2-6df583f0d9d4 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:19.402881 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b8ddfadf-3cbb-41d0-a5e2-6df583f0d9d4 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:19.583232 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-b8ddfadf-3cbb-41d0-a5e2-6df583f0d9d4 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:19.592515 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-b8ddfadf-3cbb-41d0-a5e2-6df583f0d9d4 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1363 microversion: 2.1 time: 0.209965 Sep 30 19:30:19.596558 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 135/250] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:19 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1363 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:30:19.703786 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-a5dbfbc5-595d-4834-968d-43b7f2bdc4b3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:19.704404 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-a5dbfbc5-595d-4834-968d-43b7f2bdc4b3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:19.711272 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a5dbfbc5-595d-4834-968d-43b7f2bdc4b3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:19.711927 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a5dbfbc5-595d-4834-968d-43b7f2bdc4b3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:19.712360 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a5dbfbc5-595d-4834-968d-43b7f2bdc4b3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:19.713074 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a5dbfbc5-595d-4834-968d-43b7f2bdc4b3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:19.713521 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a5dbfbc5-595d-4834-968d-43b7f2bdc4b3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:19.713942 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a5dbfbc5-595d-4834-968d-43b7f2bdc4b3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:19.892907 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-a5dbfbc5-595d-4834-968d-43b7f2bdc4b3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:19.901121 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-a5dbfbc5-595d-4834-968d-43b7f2bdc4b3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:19.902561 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-a5dbfbc5-595d-4834-968d-43b7f2bdc4b3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:19.903669 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-a5dbfbc5-595d-4834-968d-43b7f2bdc4b3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1406 microversion: 2.20 time: 0.203935 Sep 30 19:30:19.908787 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 136/251] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:30:19 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1406 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:30:19.929911 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-0f9e585c-9eda-44ad-b23c-597e8c8c73b8 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:19.930958 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-0f9e585c-9eda-44ad-b23c-597e8c8c73b8 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:19.938020 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0f9e585c-9eda-44ad-b23c-597e8c8c73b8 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:19.938198 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0f9e585c-9eda-44ad-b23c-597e8c8c73b8 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:19.938780 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0f9e585c-9eda-44ad-b23c-597e8c8c73b8 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:19.939540 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0f9e585c-9eda-44ad-b23c-597e8c8c73b8 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:19.939999 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0f9e585c-9eda-44ad-b23c-597e8c8c73b8 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:19.941131 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0f9e585c-9eda-44ad-b23c-597e8c8c73b8 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:20.103996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-0f9e585c-9eda-44ad-b23c-597e8c8c73b8 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:20.112056 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-0f9e585c-9eda-44ad-b23c-597e8c8c73b8 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d" status: 200 len: 1366 microversion: 2.1 time: 0.186204 Sep 30 19:30:20.113208 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 137/252] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:19 2022] GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:30:20.235969 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-84a3901b-4feb-4fb0-972b-3bcade551528 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:20.236607 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-84a3901b-4feb-4fb0-972b-3bcade551528 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:20.244015 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-84a3901b-4feb-4fb0-972b-3bcade551528 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:20.244717 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-84a3901b-4feb-4fb0-972b-3bcade551528 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:20.245981 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-84a3901b-4feb-4fb0-972b-3bcade551528 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:20.246819 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-84a3901b-4feb-4fb0-972b-3bcade551528 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:20.247304 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-84a3901b-4feb-4fb0-972b-3bcade551528 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:20.247729 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-84a3901b-4feb-4fb0-972b-3bcade551528 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:20.384909 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-84a3901b-4feb-4fb0-972b-3bcade551528 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:20.392676 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-84a3901b-4feb-4fb0-972b-3bcade551528 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1322 microversion: 2.1 time: 0.165275 Sep 30 19:30:20.393237 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 138/253] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:20 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:30:20.615757 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-4a74da37-850d-464e-8f94-84ae1933f053 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:20.616534 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-4a74da37-850d-464e-8f94-84ae1933f053 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:20.654287 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4a74da37-850d-464e-8f94-84ae1933f053 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:20.656727 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4a74da37-850d-464e-8f94-84ae1933f053 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:20.660294 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4a74da37-850d-464e-8f94-84ae1933f053 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:20.664682 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4a74da37-850d-464e-8f94-84ae1933f053 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:20.666902 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4a74da37-850d-464e-8f94-84ae1933f053 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:20.668263 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4a74da37-850d-464e-8f94-84ae1933f053 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:20.963521 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-7a92c5bf-2ac5-4722-8d27-523d36119d9a tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] 10.222.0.17 "POST /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 14.587475 Sep 30 19:30:20.985289 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 116/254] 10.222.0.17 () {60 vars in 1323 bytes} [Fri Sep 30 19:30:06 2022] POST /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf/os-volume_attachments => generated 194 bytes in 14610 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:30:21.022053 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-c25a5c9c-e45d-4944-82da-efba7ffbdb2c req-ae1f40f2-5f1b-4262-93dc-c0e78c972696 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "304c3216-3e08-4ea0-9ca4-ab7d78a952a9", "name": "network-vif-plugged", "status": "completed", "tag": "f09c6fe2-495b-40c6-ab14-1c805dd88322"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:30:21.039858 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-4a74da37-850d-464e-8f94-84ae1933f053 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:21.051152 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-4a74da37-850d-464e-8f94-84ae1933f053 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1363 microversion: 2.1 time: 0.439685 Sep 30 19:30:21.051748 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 139/255] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:20 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1363 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:30:21.062602 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-b47381c1-be83-4cf4-bf33-0a8cb4e5f21c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:21.063456 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-b47381c1-be83-4cf4-bf33-0a8cb4e5f21c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:21.079694 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-c25a5c9c-e45d-4944-82da-efba7ffbdb2c req-ae1f40f2-5f1b-4262-93dc-c0e78c972696 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:21.080551 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-c25a5c9c-e45d-4944-82da-efba7ffbdb2c req-ae1f40f2-5f1b-4262-93dc-c0e78c972696 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:21.082655 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-c25a5c9c-e45d-4944-82da-efba7ffbdb2c req-ae1f40f2-5f1b-4262-93dc-c0e78c972696 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:21.085398 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b47381c1-be83-4cf4-bf33-0a8cb4e5f21c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:21.089881 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b47381c1-be83-4cf4-bf33-0a8cb4e5f21c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:21.090410 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b47381c1-be83-4cf4-bf33-0a8cb4e5f21c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:21.091218 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b47381c1-be83-4cf4-bf33-0a8cb4e5f21c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:21.091749 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b47381c1-be83-4cf4-bf33-0a8cb4e5f21c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:21.093980 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b47381c1-be83-4cf4-bf33-0a8cb4e5f21c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:21.096089 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-c25a5c9c-e45d-4944-82da-efba7ffbdb2c req-ae1f40f2-5f1b-4262-93dc-c0e78c972696 service nova] Creating event network-vif-plugged:f09c6fe2-495b-40c6-ab14-1c805dd88322 for instance 304c3216-3e08-4ea0-9ca4-ab7d78a952a9 on hv-cinder-86001 Sep 30 19:30:21.104929 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-c25a5c9c-e45d-4944-82da-efba7ffbdb2c req-ae1f40f2-5f1b-4262-93dc-c0e78c972696 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106908 Sep 30 19:30:21.105717 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 117/256] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:30:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:30:21.136904 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-7e8889b3-285e-4dac-8898-1b392e5d9f03 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:21.138022 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-7e8889b3-285e-4dac-8898-1b392e5d9f03 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:21.149497 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7e8889b3-285e-4dac-8898-1b392e5d9f03 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:21.150338 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7e8889b3-285e-4dac-8898-1b392e5d9f03 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:21.150965 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7e8889b3-285e-4dac-8898-1b392e5d9f03 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:21.151827 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7e8889b3-285e-4dac-8898-1b392e5d9f03 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:21.152492 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7e8889b3-285e-4dac-8898-1b392e5d9f03 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:21.153157 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7e8889b3-285e-4dac-8898-1b392e5d9f03 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:21.263599 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-b47381c1-be83-4cf4-bf33-0a8cb4e5f21c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:21.276061 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-b47381c1-be83-4cf4-bf33-0a8cb4e5f21c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:21.277625 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-b47381c1-be83-4cf4-bf33-0a8cb4e5f21c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:21.278741 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-b47381c1-be83-4cf4-bf33-0a8cb4e5f21c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1406 microversion: 2.20 time: 0.221749 Sep 30 19:30:21.280564 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 140/257] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:30:21 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1406 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:30:21.394275 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-7e8889b3-285e-4dac-8898-1b392e5d9f03 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:21.404513 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-7e8889b3-285e-4dac-8898-1b392e5d9f03 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d" status: 200 len: 1366 microversion: 2.1 time: 0.272671 Sep 30 19:30:21.405910 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 118/258] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:21 2022] GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d => generated 1366 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:30:21.415262 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-3d152e6f-8616-45aa-a7ba-5267a1c5fbc0 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:21.418166 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-3d152e6f-8616-45aa-a7ba-5267a1c5fbc0 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:21.424204 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3d152e6f-8616-45aa-a7ba-5267a1c5fbc0 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:21.425316 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3d152e6f-8616-45aa-a7ba-5267a1c5fbc0 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:21.425859 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3d152e6f-8616-45aa-a7ba-5267a1c5fbc0 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:21.426672 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3d152e6f-8616-45aa-a7ba-5267a1c5fbc0 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:21.427244 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3d152e6f-8616-45aa-a7ba-5267a1c5fbc0 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:21.427805 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3d152e6f-8616-45aa-a7ba-5267a1c5fbc0 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:21.569283 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-3d152e6f-8616-45aa-a7ba-5267a1c5fbc0 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:21.577569 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-3d152e6f-8616-45aa-a7ba-5267a1c5fbc0 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1322 microversion: 2.1 time: 0.166108 Sep 30 19:30:21.578271 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 141/259] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:21 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:30:22.077925 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-90b20310-7a05-4eb8-a76c-1d5533312dc4 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:22.078589 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-90b20310-7a05-4eb8-a76c-1d5533312dc4 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:22.085604 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-90b20310-7a05-4eb8-a76c-1d5533312dc4 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:22.086089 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-90b20310-7a05-4eb8-a76c-1d5533312dc4 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:22.086519 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-90b20310-7a05-4eb8-a76c-1d5533312dc4 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:22.087324 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-90b20310-7a05-4eb8-a76c-1d5533312dc4 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:22.087772 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-90b20310-7a05-4eb8-a76c-1d5533312dc4 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:22.088464 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-90b20310-7a05-4eb8-a76c-1d5533312dc4 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:22.272871 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-90b20310-7a05-4eb8-a76c-1d5533312dc4 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:22.287706 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-90b20310-7a05-4eb8-a76c-1d5533312dc4 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1363 microversion: 2.1 time: 0.211839 Sep 30 19:30:22.288939 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 119/260] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:22 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1363 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:30:22.310109 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-fc493e86-226d-46f6-b7a6-d0965d7edcb5 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:22.311122 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-fc493e86-226d-46f6-b7a6-d0965d7edcb5 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:22.318566 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-fc493e86-226d-46f6-b7a6-d0965d7edcb5 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:22.319051 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-fc493e86-226d-46f6-b7a6-d0965d7edcb5 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:22.319481 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-fc493e86-226d-46f6-b7a6-d0965d7edcb5 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:22.320338 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-fc493e86-226d-46f6-b7a6-d0965d7edcb5 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:22.321110 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-fc493e86-226d-46f6-b7a6-d0965d7edcb5 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:22.321696 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-fc493e86-226d-46f6-b7a6-d0965d7edcb5 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:22.430431 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-9ba77ed4-cb0b-400c-a746-6ece311c8643 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:22.431343 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-9ba77ed4-cb0b-400c-a746-6ece311c8643 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:22.442430 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9ba77ed4-cb0b-400c-a746-6ece311c8643 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:22.443522 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9ba77ed4-cb0b-400c-a746-6ece311c8643 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:22.444328 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9ba77ed4-cb0b-400c-a746-6ece311c8643 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:22.446188 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9ba77ed4-cb0b-400c-a746-6ece311c8643 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:22.447133 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9ba77ed4-cb0b-400c-a746-6ece311c8643 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:22.447747 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9ba77ed4-cb0b-400c-a746-6ece311c8643 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:22.637541 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-fc493e86-226d-46f6-b7a6-d0965d7edcb5 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:22.652311 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-fc493e86-226d-46f6-b7a6-d0965d7edcb5 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:22.654351 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-fc493e86-226d-46f6-b7a6-d0965d7edcb5 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:22.655530 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-fc493e86-226d-46f6-b7a6-d0965d7edcb5 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1406 microversion: 2.20 time: 0.349657 Sep 30 19:30:22.662528 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 142/261] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:30:22 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1406 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:30:22.665389 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-9ba77ed4-cb0b-400c-a746-6ece311c8643 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:22.667866 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-5423ff5f-ae35-4d62-81a3-6df8028a2198 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:22.668484 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-5423ff5f-ae35-4d62-81a3-6df8028a2198 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:22.676273 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-9ba77ed4-cb0b-400c-a746-6ece311c8643 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d" status: 200 len: 1366 microversion: 2.1 time: 0.251678 Sep 30 19:30:22.677103 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 120/262] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:22 2022] GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d => generated 1366 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:30:22.681375 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5423ff5f-ae35-4d62-81a3-6df8028a2198 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:22.686239 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5423ff5f-ae35-4d62-81a3-6df8028a2198 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:22.686845 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5423ff5f-ae35-4d62-81a3-6df8028a2198 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:22.687727 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5423ff5f-ae35-4d62-81a3-6df8028a2198 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:22.688338 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5423ff5f-ae35-4d62-81a3-6df8028a2198 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:22.689087 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5423ff5f-ae35-4d62-81a3-6df8028a2198 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:23.314333 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-267d836f-a537-4e99-ab5f-d62aa38b12a6 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:23.314956 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-267d836f-a537-4e99-ab5f-d62aa38b12a6 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:23.327681 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-267d836f-a537-4e99-ab5f-d62aa38b12a6 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:23.328169 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-267d836f-a537-4e99-ab5f-d62aa38b12a6 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:23.328998 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-267d836f-a537-4e99-ab5f-d62aa38b12a6 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:23.329869 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-267d836f-a537-4e99-ab5f-d62aa38b12a6 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:23.330467 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-267d836f-a537-4e99-ab5f-d62aa38b12a6 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:23.331778 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-267d836f-a537-4e99-ab5f-d62aa38b12a6 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:23.337728 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-5423ff5f-ae35-4d62-81a3-6df8028a2198 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:23.346022 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-5423ff5f-ae35-4d62-81a3-6df8028a2198 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1322 microversion: 2.1 time: 0.682197 Sep 30 19:30:23.347163 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 143/263] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:22 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1322 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:30:23.593933 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-267d836f-a537-4e99-ab5f-d62aa38b12a6 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:23.602144 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-267d836f-a537-4e99-ab5f-d62aa38b12a6 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1363 microversion: 2.1 time: 0.292932 Sep 30 19:30:23.615422 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 121/264] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:23 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1363 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:30:23.683503 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-e1d6214b-3ba9-4424-978a-3a08a2bc24c9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:23.684906 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-e1d6214b-3ba9-4424-978a-3a08a2bc24c9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:23.692931 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e1d6214b-3ba9-4424-978a-3a08a2bc24c9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:23.693424 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e1d6214b-3ba9-4424-978a-3a08a2bc24c9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:23.693858 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e1d6214b-3ba9-4424-978a-3a08a2bc24c9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:23.694586 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e1d6214b-3ba9-4424-978a-3a08a2bc24c9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:23.695239 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e1d6214b-3ba9-4424-978a-3a08a2bc24c9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:23.695669 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e1d6214b-3ba9-4424-978a-3a08a2bc24c9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:23.699689 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-62885239-016d-49bd-88e9-137658896612 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:23.700293 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-62885239-016d-49bd-88e9-137658896612 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:23.706946 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-62885239-016d-49bd-88e9-137658896612 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:23.707633 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-62885239-016d-49bd-88e9-137658896612 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:23.708241 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-62885239-016d-49bd-88e9-137658896612 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:23.709136 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-62885239-016d-49bd-88e9-137658896612 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:23.710401 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-62885239-016d-49bd-88e9-137658896612 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:23.711159 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-62885239-016d-49bd-88e9-137658896612 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:23.916421 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-62885239-016d-49bd-88e9-137658896612 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:23.924559 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-62885239-016d-49bd-88e9-137658896612 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d" status: 200 len: 1366 microversion: 2.1 time: 0.228651 Sep 30 19:30:23.927778 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 122/265] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:23 2022] GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:30:24.020007 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-e1d6214b-3ba9-4424-978a-3a08a2bc24c9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:24.031776 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-e1d6214b-3ba9-4424-978a-3a08a2bc24c9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:24.035463 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-e1d6214b-3ba9-4424-978a-3a08a2bc24c9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:24.037772 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-e1d6214b-3ba9-4424-978a-3a08a2bc24c9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1406 microversion: 2.20 time: 0.358499 Sep 30 19:30:24.044091 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 144/266] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:30:23 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1406 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:30:24.376320 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-cdc12c6c-b2f7-4ba8-a926-c2513e0b9930 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:24.377326 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-cdc12c6c-b2f7-4ba8-a926-c2513e0b9930 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:24.398774 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cdc12c6c-b2f7-4ba8-a926-c2513e0b9930 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:24.399269 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cdc12c6c-b2f7-4ba8-a926-c2513e0b9930 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:24.399711 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cdc12c6c-b2f7-4ba8-a926-c2513e0b9930 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:24.400501 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cdc12c6c-b2f7-4ba8-a926-c2513e0b9930 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:24.400963 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cdc12c6c-b2f7-4ba8-a926-c2513e0b9930 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:24.401395 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cdc12c6c-b2f7-4ba8-a926-c2513e0b9930 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:24.629590 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-8f614169-d2b6-49b3-98bc-e47f8c5ca57c tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:24.640388 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-8f614169-d2b6-49b3-98bc-e47f8c5ca57c tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:24.661989 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8f614169-d2b6-49b3-98bc-e47f8c5ca57c tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:24.662710 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8f614169-d2b6-49b3-98bc-e47f8c5ca57c tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:24.664281 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8f614169-d2b6-49b3-98bc-e47f8c5ca57c tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:24.665227 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8f614169-d2b6-49b3-98bc-e47f8c5ca57c tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:24.665838 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8f614169-d2b6-49b3-98bc-e47f8c5ca57c tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:24.666467 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8f614169-d2b6-49b3-98bc-e47f8c5ca57c tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:24.730880 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-cdc12c6c-b2f7-4ba8-a926-c2513e0b9930 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:24.742436 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-cdc12c6c-b2f7-4ba8-a926-c2513e0b9930 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1322 microversion: 2.1 time: 0.375427 Sep 30 19:30:24.743550 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 123/267] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:24 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1322 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:30:24.950432 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-69d87b44-66a1-4c06-9822-bb74ec999f55 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:24.951293 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-69d87b44-66a1-4c06-9822-bb74ec999f55 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:24.962755 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-69d87b44-66a1-4c06-9822-bb74ec999f55 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:24.964621 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-69d87b44-66a1-4c06-9822-bb74ec999f55 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:24.965068 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-69d87b44-66a1-4c06-9822-bb74ec999f55 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:24.965784 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-69d87b44-66a1-4c06-9822-bb74ec999f55 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:24.971037 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-69d87b44-66a1-4c06-9822-bb74ec999f55 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:24.971826 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-69d87b44-66a1-4c06-9822-bb74ec999f55 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:25.231575 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-69d87b44-66a1-4c06-9822-bb74ec999f55 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:25.242896 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-69d87b44-66a1-4c06-9822-bb74ec999f55 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d" status: 200 len: 1555 microversion: 2.1 time: 0.296232 Sep 30 19:30:25.243786 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 124/268] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:24 2022] GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d => generated 1555 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:30:25.250644 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-96cb6cb6-a627-4814-bdf1-c0d67708e6bb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:25.251542 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-96cb6cb6-a627-4814-bdf1-c0d67708e6bb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:25.264894 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-96cb6cb6-a627-4814-bdf1-c0d67708e6bb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:25.266250 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-96cb6cb6-a627-4814-bdf1-c0d67708e6bb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:25.266981 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-96cb6cb6-a627-4814-bdf1-c0d67708e6bb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:25.267911 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-96cb6cb6-a627-4814-bdf1-c0d67708e6bb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:25.270222 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-96cb6cb6-a627-4814-bdf1-c0d67708e6bb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:25.270795 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-96cb6cb6-a627-4814-bdf1-c0d67708e6bb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:25.321115 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-8f614169-d2b6-49b3-98bc-e47f8c5ca57c tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:25.329699 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-8f614169-d2b6-49b3-98bc-e47f8c5ca57c tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1363 microversion: 2.1 time: 0.708505 Sep 30 19:30:25.332911 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 145/269] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:24 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1363 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:30:25.340932 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-c43e816e-cf81-418c-843d-10c6a7c1f06f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:25.344971 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-c43e816e-cf81-418c-843d-10c6a7c1f06f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:25.358647 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c43e816e-cf81-418c-843d-10c6a7c1f06f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:25.360914 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c43e816e-cf81-418c-843d-10c6a7c1f06f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:25.361635 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c43e816e-cf81-418c-843d-10c6a7c1f06f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:25.364083 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c43e816e-cf81-418c-843d-10c6a7c1f06f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:25.367933 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c43e816e-cf81-418c-843d-10c6a7c1f06f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:25.369181 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c43e816e-cf81-418c-843d-10c6a7c1f06f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:25.503163 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-96cb6cb6-a627-4814-bdf1-c0d67708e6bb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:25.522248 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-96cb6cb6-a627-4814-bdf1-c0d67708e6bb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:25.524498 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-96cb6cb6-a627-4814-bdf1-c0d67708e6bb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:25.526375 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-96cb6cb6-a627-4814-bdf1-c0d67708e6bb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1406 microversion: 2.20 time: 0.281263 Sep 30 19:30:25.527146 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 125/270] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:30:25 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1406 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:30:25.649908 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-c43e816e-cf81-418c-843d-10c6a7c1f06f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.314721 Sep 30 19:30:25.650574 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 146/271] 10.222.0.17 () {58 vars in 1275 bytes} [Fri Sep 30 19:30:25 2022] GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d/os-interface => generated 284 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:30:25.769206 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-c6dc3918-9cb5-4a45-ba05-0f3a0b68ef45 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:25.769982 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-c6dc3918-9cb5-4a45-ba05-0f3a0b68ef45 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:25.777723 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c6dc3918-9cb5-4a45-ba05-0f3a0b68ef45 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:25.778213 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c6dc3918-9cb5-4a45-ba05-0f3a0b68ef45 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:25.778644 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c6dc3918-9cb5-4a45-ba05-0f3a0b68ef45 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:25.779348 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c6dc3918-9cb5-4a45-ba05-0f3a0b68ef45 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:25.782302 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c6dc3918-9cb5-4a45-ba05-0f3a0b68ef45 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:25.785890 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c6dc3918-9cb5-4a45-ba05-0f3a0b68ef45 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:26.358496 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-3b5ebc1e-9dd4-4023-8400-88cb54f928c4 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:26.359167 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-3b5ebc1e-9dd4-4023-8400-88cb54f928c4 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:26.374454 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3b5ebc1e-9dd4-4023-8400-88cb54f928c4 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:26.374953 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3b5ebc1e-9dd4-4023-8400-88cb54f928c4 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:26.375441 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3b5ebc1e-9dd4-4023-8400-88cb54f928c4 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:26.376208 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3b5ebc1e-9dd4-4023-8400-88cb54f928c4 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:26.376690 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3b5ebc1e-9dd4-4023-8400-88cb54f928c4 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:26.379721 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3b5ebc1e-9dd4-4023-8400-88cb54f928c4 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:26.388054 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-c6dc3918-9cb5-4a45-ba05-0f3a0b68ef45 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:26.408204 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-c6dc3918-9cb5-4a45-ba05-0f3a0b68ef45 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1322 microversion: 2.1 time: 0.643356 Sep 30 19:30:26.408970 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 126/272] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:25 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1322 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:30:26.553140 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-d089b359-c087-44b6-beff-1af497821727 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:26.553767 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-d089b359-c087-44b6-beff-1af497821727 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:26.567285 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d089b359-c087-44b6-beff-1af497821727 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:26.567800 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d089b359-c087-44b6-beff-1af497821727 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:26.568249 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d089b359-c087-44b6-beff-1af497821727 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:26.571192 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d089b359-c087-44b6-beff-1af497821727 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:26.571790 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d089b359-c087-44b6-beff-1af497821727 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:26.572103 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d089b359-c087-44b6-beff-1af497821727 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:27.004046 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-d089b359-c087-44b6-beff-1af497821727 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:27.016056 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-d089b359-c087-44b6-beff-1af497821727 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:27.022494 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-d089b359-c087-44b6-beff-1af497821727 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:27.024703 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-d089b359-c087-44b6-beff-1af497821727 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1406 microversion: 2.20 time: 0.477156 Sep 30 19:30:27.025465 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 127/273] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:30:26 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1406 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:30:27.141441 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-3b5ebc1e-9dd4-4023-8400-88cb54f928c4 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:27.151945 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-3b5ebc1e-9dd4-4023-8400-88cb54f928c4 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1363 microversion: 2.1 time: 0.797933 Sep 30 19:30:27.166687 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 147/274] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:26 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1363 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:30:27.433851 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-a89f472d-649c-490c-b02e-7dacf49f7515 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:27.438340 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-a89f472d-649c-490c-b02e-7dacf49f7515 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:27.449760 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a89f472d-649c-490c-b02e-7dacf49f7515 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:27.450631 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a89f472d-649c-490c-b02e-7dacf49f7515 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:27.452144 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a89f472d-649c-490c-b02e-7dacf49f7515 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:27.458063 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a89f472d-649c-490c-b02e-7dacf49f7515 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:27.459003 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a89f472d-649c-490c-b02e-7dacf49f7515 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:27.460196 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a89f472d-649c-490c-b02e-7dacf49f7515 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:27.840512 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-a89f472d-649c-490c-b02e-7dacf49f7515 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:27.849717 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-a89f472d-649c-490c-b02e-7dacf49f7515 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1322 microversion: 2.1 time: 0.420630 Sep 30 19:30:27.855248 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 128/275] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:27 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1322 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:30:27.981596 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [req-7b56596a-6754-41fd-ad7a-96bf42942152 req-b2a677c0-85ae-4040-a38b-667aae4534f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a84ee4e3-e6e4-4574-810f-8e5e796b4c4d", "tag": "703c0c85-a09a-452a-a548-87d9d670da7d"}]} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:30:27.996409 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-7b56596a-6754-41fd-ad7a-96bf42942152 req-b2a677c0-85ae-4040-a38b-667aae4534f8 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:27.997697 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-7b56596a-6754-41fd-ad7a-96bf42942152 req-b2a677c0-85ae-4040-a38b-667aae4534f8 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:27.998124 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-7b56596a-6754-41fd-ad7a-96bf42942152 req-b2a677c0-85ae-4040-a38b-667aae4534f8 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:28.010981 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.compute.server_external_events [req-7b56596a-6754-41fd-ad7a-96bf42942152 req-b2a677c0-85ae-4040-a38b-667aae4534f8 service nova] Creating event network-changed:703c0c85-a09a-452a-a548-87d9d670da7d for instance a84ee4e3-e6e4-4574-810f-8e5e796b4c4d on hv-cinder-86001 Sep 30 19:30:28.018838 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [req-7b56596a-6754-41fd-ad7a-96bf42942152 req-b2a677c0-85ae-4040-a38b-667aae4534f8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040464 Sep 30 19:30:28.025755 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 148/276] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:30:28.055648 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-3e3393d8-6e7e-4ad8-a756-13a7ec6d12e0 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:28.056385 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-3e3393d8-6e7e-4ad8-a756-13a7ec6d12e0 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:28.063070 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3e3393d8-6e7e-4ad8-a756-13a7ec6d12e0 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:28.063828 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3e3393d8-6e7e-4ad8-a756-13a7ec6d12e0 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:28.064728 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3e3393d8-6e7e-4ad8-a756-13a7ec6d12e0 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:28.065664 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3e3393d8-6e7e-4ad8-a756-13a7ec6d12e0 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:28.066217 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3e3393d8-6e7e-4ad8-a756-13a7ec6d12e0 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:28.066744 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3e3393d8-6e7e-4ad8-a756-13a7ec6d12e0 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:28.181324 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-67b0a31b-3de5-4826-a9a2-de839be3308b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:28.182401 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-67b0a31b-3de5-4826-a9a2-de839be3308b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:28.191527 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-67b0a31b-3de5-4826-a9a2-de839be3308b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:28.192136 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-67b0a31b-3de5-4826-a9a2-de839be3308b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:28.192680 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-67b0a31b-3de5-4826-a9a2-de839be3308b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:28.193730 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-67b0a31b-3de5-4826-a9a2-de839be3308b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:28.194382 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-67b0a31b-3de5-4826-a9a2-de839be3308b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:28.195362 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-67b0a31b-3de5-4826-a9a2-de839be3308b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:28.216580 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-3e3393d8-6e7e-4ad8-a756-13a7ec6d12e0 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:28.227443 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell1:SELECT=100 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:28.228625 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-3e3393d8-6e7e-4ad8-a756-13a7ec6d12e0 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:28.230802 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-3e3393d8-6e7e-4ad8-a756-13a7ec6d12e0 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:28.232327 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-3e3393d8-6e7e-4ad8-a756-13a7ec6d12e0 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1406 microversion: 2.20 time: 0.181753 Sep 30 19:30:28.233404 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 129/277] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:30:28 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:30:28.368002 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-67b0a31b-3de5-4826-a9a2-de839be3308b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:28.376879 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-67b0a31b-3de5-4826-a9a2-de839be3308b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1363 microversion: 2.1 time: 0.200623 Sep 30 19:30:28.378276 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 149/278] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:28 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1363 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:30:28.876397 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-5d0661c7-3efc-4187-8c8a-50c0bc09726d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:28.877048 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-5d0661c7-3efc-4187-8c8a-50c0bc09726d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:28.892045 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5d0661c7-3efc-4187-8c8a-50c0bc09726d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:28.892579 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5d0661c7-3efc-4187-8c8a-50c0bc09726d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:28.893027 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5d0661c7-3efc-4187-8c8a-50c0bc09726d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:28.894264 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5d0661c7-3efc-4187-8c8a-50c0bc09726d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:28.894726 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5d0661c7-3efc-4187-8c8a-50c0bc09726d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:28.895189 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5d0661c7-3efc-4187-8c8a-50c0bc09726d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:29.259098 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-34379425-bb75-4b2b-91ad-b5532c05f260 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:29.260306 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-34379425-bb75-4b2b-91ad-b5532c05f260 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:29.267239 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-34379425-bb75-4b2b-91ad-b5532c05f260 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:29.267726 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-34379425-bb75-4b2b-91ad-b5532c05f260 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:29.272597 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-34379425-bb75-4b2b-91ad-b5532c05f260 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:29.273353 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-34379425-bb75-4b2b-91ad-b5532c05f260 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:29.273834 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-34379425-bb75-4b2b-91ad-b5532c05f260 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:29.277860 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-34379425-bb75-4b2b-91ad-b5532c05f260 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:29.325695 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-5d0661c7-3efc-4187-8c8a-50c0bc09726d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:29.344395 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-5d0661c7-3efc-4187-8c8a-50c0bc09726d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1322 microversion: 2.1 time: 0.471534 Sep 30 19:30:29.346006 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 130/279] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:28 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1322 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:30:29.402801 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-66f97872-0a3d-4230-b620-38a8a07007ab tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:29.405588 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-66f97872-0a3d-4230-b620-38a8a07007ab tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:29.421145 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-66f97872-0a3d-4230-b620-38a8a07007ab tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:29.427082 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-66f97872-0a3d-4230-b620-38a8a07007ab tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:29.428394 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-66f97872-0a3d-4230-b620-38a8a07007ab tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:29.429419 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-66f97872-0a3d-4230-b620-38a8a07007ab tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:29.430289 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-66f97872-0a3d-4230-b620-38a8a07007ab tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:29.434111 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-66f97872-0a3d-4230-b620-38a8a07007ab tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:29.599202 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-34379425-bb75-4b2b-91ad-b5532c05f260 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:29.632634 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-34379425-bb75-4b2b-91ad-b5532c05f260 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:29.639789 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-34379425-bb75-4b2b-91ad-b5532c05f260 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:29.641343 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-34379425-bb75-4b2b-91ad-b5532c05f260 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1406 microversion: 2.20 time: 0.387105 Sep 30 19:30:29.643666 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 150/280] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:30:29 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1406 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:30:29.659569 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [req-98aefb9b-2356-4604-8adf-78a02071ef1c req-e1a82274-47e2-445a-963a-08f0ea4c3b11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31", "name": "network-vif-plugged", "status": "completed", "tag": "55d19521-9bc7-4a83-a9b2-6c9a8c1ae53f"}]} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:30:29.684703 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-98aefb9b-2356-4604-8adf-78a02071ef1c req-e1a82274-47e2-445a-963a-08f0ea4c3b11 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:29.685195 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-98aefb9b-2356-4604-8adf-78a02071ef1c req-e1a82274-47e2-445a-963a-08f0ea4c3b11 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:29.685633 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-98aefb9b-2356-4604-8adf-78a02071ef1c req-e1a82274-47e2-445a-963a-08f0ea4c3b11 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:29.700830 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.compute.server_external_events [req-98aefb9b-2356-4604-8adf-78a02071ef1c req-e1a82274-47e2-445a-963a-08f0ea4c3b11 service nova] Creating event network-vif-plugged:55d19521-9bc7-4a83-a9b2-6c9a8c1ae53f for instance 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 on hv-cinder-86001 Sep 30 19:30:29.711045 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [req-98aefb9b-2356-4604-8adf-78a02071ef1c req-e1a82274-47e2-445a-963a-08f0ea4c3b11 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061114 Sep 30 19:30:29.714394 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 151/281] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:30:29.803612 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-66f97872-0a3d-4230-b620-38a8a07007ab tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:29.824214 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-66f97872-0a3d-4230-b620-38a8a07007ab tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1363 microversion: 2.1 time: 0.427173 Sep 30 19:30:29.835964 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 131/282] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:29 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1363 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:30:30.393552 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-43393b83-40bb-4554-b12b-762af040e713 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:30.408071 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-43393b83-40bb-4554-b12b-762af040e713 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:30.446658 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-43393b83-40bb-4554-b12b-762af040e713 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:30.451869 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-43393b83-40bb-4554-b12b-762af040e713 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:30.453354 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-43393b83-40bb-4554-b12b-762af040e713 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:30.455104 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-43393b83-40bb-4554-b12b-762af040e713 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:30.461366 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-43393b83-40bb-4554-b12b-762af040e713 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:30.464677 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-43393b83-40bb-4554-b12b-762af040e713 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:30.677922 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-0b8621ee-157a-46f5-8741-83e205ae3e2a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:30.679164 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-0b8621ee-157a-46f5-8741-83e205ae3e2a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:30.709698 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0b8621ee-157a-46f5-8741-83e205ae3e2a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:30.710204 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0b8621ee-157a-46f5-8741-83e205ae3e2a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:30.710648 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0b8621ee-157a-46f5-8741-83e205ae3e2a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:30.719170 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0b8621ee-157a-46f5-8741-83e205ae3e2a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:30.720777 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0b8621ee-157a-46f5-8741-83e205ae3e2a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:30.724175 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0b8621ee-157a-46f5-8741-83e205ae3e2a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:31.236235 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-43393b83-40bb-4554-b12b-762af040e713 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:31.247438 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-43393b83-40bb-4554-b12b-762af040e713 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1322 microversion: 2.1 time: 0.871185 Sep 30 19:30:31.250058 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 152/283] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:30 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1322 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:30:31.263499 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-becfc64f-f3f6-476c-aaf9-f888b47658b9 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:31.264351 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-becfc64f-f3f6-476c-aaf9-f888b47658b9 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:31.282447 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-becfc64f-f3f6-476c-aaf9-f888b47658b9 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:31.285466 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-becfc64f-f3f6-476c-aaf9-f888b47658b9 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:31.286087 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-becfc64f-f3f6-476c-aaf9-f888b47658b9 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:31.288037 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-becfc64f-f3f6-476c-aaf9-f888b47658b9 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:31.288704 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-becfc64f-f3f6-476c-aaf9-f888b47658b9 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:31.290870 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-becfc64f-f3f6-476c-aaf9-f888b47658b9 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:31.782115 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-0b8621ee-157a-46f5-8741-83e205ae3e2a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:31.787917 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:31.797105 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-0b8621ee-157a-46f5-8741-83e205ae3e2a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:31.798929 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-0b8621ee-157a-46f5-8741-83e205ae3e2a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:31.801033 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-0b8621ee-157a-46f5-8741-83e205ae3e2a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1406 microversion: 2.20 time: 1.130828 Sep 30 19:30:31.812456 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 132/284] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:30:30 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1406 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:30:31.814508 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-becfc64f-f3f6-476c-aaf9-f888b47658b9 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:31.826450 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-becfc64f-f3f6-476c-aaf9-f888b47658b9 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1549 microversion: 2.1 time: 0.574505 Sep 30 19:30:31.827041 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 153/285] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:31 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1549 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:30:31.857930 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e4eb574b-2147-4b9d-9308-7aaeca54e92d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:31.859703 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-e4eb574b-2147-4b9d-9308-7aaeca54e92d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:31.869790 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e4eb574b-2147-4b9d-9308-7aaeca54e92d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:31.870577 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e4eb574b-2147-4b9d-9308-7aaeca54e92d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:31.871222 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e4eb574b-2147-4b9d-9308-7aaeca54e92d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:31.873032 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e4eb574b-2147-4b9d-9308-7aaeca54e92d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:31.873848 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e4eb574b-2147-4b9d-9308-7aaeca54e92d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:31.874560 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e4eb574b-2147-4b9d-9308-7aaeca54e92d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:32.062326 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-e4eb574b-2147-4b9d-9308-7aaeca54e92d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.213926 Sep 30 19:30:32.063198 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 133/286] 10.222.0.17 () {58 vars in 1275 bytes} [Fri Sep 30 19:30:31 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9/os-interface => generated 284 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 30 19:30:32.274817 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-5719f628-1850-4d3c-8d6a-40f8db73e0bd tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:32.275757 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-5719f628-1850-4d3c-8d6a-40f8db73e0bd tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:32.294173 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5719f628-1850-4d3c-8d6a-40f8db73e0bd tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:32.296358 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5719f628-1850-4d3c-8d6a-40f8db73e0bd tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:32.297134 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5719f628-1850-4d3c-8d6a-40f8db73e0bd tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:32.299244 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5719f628-1850-4d3c-8d6a-40f8db73e0bd tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:32.299877 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5719f628-1850-4d3c-8d6a-40f8db73e0bd tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:32.300999 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5719f628-1850-4d3c-8d6a-40f8db73e0bd tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:32.759989 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-5719f628-1850-4d3c-8d6a-40f8db73e0bd tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:32.780814 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-5719f628-1850-4d3c-8d6a-40f8db73e0bd tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1322 microversion: 2.1 time: 0.512541 Sep 30 19:30:32.799102 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 154/287] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:32 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1322 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:30:32.837989 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-b92cc9fa-68be-4cb8-b9fa-5230e2f8d395 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:32.844974 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-b92cc9fa-68be-4cb8-b9fa-5230e2f8d395 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:32.864647 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b92cc9fa-68be-4cb8-b9fa-5230e2f8d395 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:32.866448 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b92cc9fa-68be-4cb8-b9fa-5230e2f8d395 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:32.867088 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b92cc9fa-68be-4cb8-b9fa-5230e2f8d395 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:32.868028 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b92cc9fa-68be-4cb8-b9fa-5230e2f8d395 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:32.868891 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b92cc9fa-68be-4cb8-b9fa-5230e2f8d395 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:32.869611 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b92cc9fa-68be-4cb8-b9fa-5230e2f8d395 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:33.733730 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-b92cc9fa-68be-4cb8-b9fa-5230e2f8d395 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:33.744905 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-b92cc9fa-68be-4cb8-b9fa-5230e2f8d395 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:33.746378 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-b92cc9fa-68be-4cb8-b9fa-5230e2f8d395 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:33.759139 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-b92cc9fa-68be-4cb8-b9fa-5230e2f8d395 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1406 microversion: 2.20 time: 0.933582 Sep 30 19:30:33.765474 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 134/288] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:30:32 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1406 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:30:33.811185 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-4098785e-f92d-4416-b4d7-2a646a54b524 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:33.816323 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-4098785e-f92d-4416-b4d7-2a646a54b524 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:33.837558 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4098785e-f92d-4416-b4d7-2a646a54b524 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:33.838058 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4098785e-f92d-4416-b4d7-2a646a54b524 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:33.838501 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4098785e-f92d-4416-b4d7-2a646a54b524 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:33.843625 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4098785e-f92d-4416-b4d7-2a646a54b524 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:33.844210 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4098785e-f92d-4416-b4d7-2a646a54b524 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:33.852510 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4098785e-f92d-4416-b4d7-2a646a54b524 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:34.677620 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-4098785e-f92d-4416-b4d7-2a646a54b524 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:34.694155 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-4098785e-f92d-4416-b4d7-2a646a54b524 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1322 microversion: 2.1 time: 0.887917 Sep 30 19:30:34.708527 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 155/289] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:33 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1322 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:30:34.795818 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-81b1aa51-b06e-4210-8740-0cb607876e2a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:34.796666 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-81b1aa51-b06e-4210-8740-0cb607876e2a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:34.816320 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-81b1aa51-b06e-4210-8740-0cb607876e2a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:34.819107 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-81b1aa51-b06e-4210-8740-0cb607876e2a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:34.820142 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-81b1aa51-b06e-4210-8740-0cb607876e2a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:34.825663 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-81b1aa51-b06e-4210-8740-0cb607876e2a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:34.828350 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-81b1aa51-b06e-4210-8740-0cb607876e2a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:34.832661 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-81b1aa51-b06e-4210-8740-0cb607876e2a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:35.462552 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-81b1aa51-b06e-4210-8740-0cb607876e2a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:35.481915 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-81b1aa51-b06e-4210-8740-0cb607876e2a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:35.488808 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-81b1aa51-b06e-4210-8740-0cb607876e2a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:35.494606 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-81b1aa51-b06e-4210-8740-0cb607876e2a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1406 microversion: 2.20 time: 0.703104 Sep 30 19:30:35.498867 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 135/290] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:30:34 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1406 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:30:35.725414 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-0f596654-e20c-4880-8766-cfb72d8c9533 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:35.726080 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-0f596654-e20c-4880-8766-cfb72d8c9533 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:35.741923 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0f596654-e20c-4880-8766-cfb72d8c9533 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:35.742815 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0f596654-e20c-4880-8766-cfb72d8c9533 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:35.743913 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0f596654-e20c-4880-8766-cfb72d8c9533 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:35.748293 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0f596654-e20c-4880-8766-cfb72d8c9533 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:35.751140 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0f596654-e20c-4880-8766-cfb72d8c9533 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:35.751814 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0f596654-e20c-4880-8766-cfb72d8c9533 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:36.415796 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-1e9c6c44-b73a-4340-828f-64397a114a13 req-4e5e4cf3-5145-4cae-bc1a-f93d41483d78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "304c3216-3e08-4ea0-9ca4-ab7d78a952a9", "tag": "f09c6fe2-495b-40c6-ab14-1c805dd88322"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:30:36.435034 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-1e9c6c44-b73a-4340-828f-64397a114a13 req-4e5e4cf3-5145-4cae-bc1a-f93d41483d78 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:36.435988 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-0f596654-e20c-4880-8766-cfb72d8c9533 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:36.440212 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-1e9c6c44-b73a-4340-828f-64397a114a13 req-4e5e4cf3-5145-4cae-bc1a-f93d41483d78 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:36.440715 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-1e9c6c44-b73a-4340-828f-64397a114a13 req-4e5e4cf3-5145-4cae-bc1a-f93d41483d78 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:36.452309 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-0f596654-e20c-4880-8766-cfb72d8c9533 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1322 microversion: 2.1 time: 0.733489 Sep 30 19:30:36.468585 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 156/291] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:35 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1322 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:30:36.483192 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-1e9c6c44-b73a-4340-828f-64397a114a13 req-4e5e4cf3-5145-4cae-bc1a-f93d41483d78 service nova] Creating event network-changed:f09c6fe2-495b-40c6-ab14-1c805dd88322 for instance 304c3216-3e08-4ea0-9ca4-ab7d78a952a9 on hv-cinder-86001 Sep 30 19:30:36.504184 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-1e9c6c44-b73a-4340-828f-64397a114a13 req-4e5e4cf3-5145-4cae-bc1a-f93d41483d78 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084221 Sep 30 19:30:36.504903 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 136/292] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:30:36.523750 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-0a4b5c43-33bb-4cb9-825f-6215275a17ca tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:36.524540 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-0a4b5c43-33bb-4cb9-825f-6215275a17ca tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:36.532736 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0a4b5c43-33bb-4cb9-825f-6215275a17ca tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:36.533580 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0a4b5c43-33bb-4cb9-825f-6215275a17ca tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:36.534497 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0a4b5c43-33bb-4cb9-825f-6215275a17ca tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:36.537308 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0a4b5c43-33bb-4cb9-825f-6215275a17ca tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:36.541047 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0a4b5c43-33bb-4cb9-825f-6215275a17ca tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:36.541820 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0a4b5c43-33bb-4cb9-825f-6215275a17ca tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:36.855086 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-0a4b5c43-33bb-4cb9-825f-6215275a17ca tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:36.869982 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-0a4b5c43-33bb-4cb9-825f-6215275a17ca tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:36.872749 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-0a4b5c43-33bb-4cb9-825f-6215275a17ca tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:36.874406 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-0a4b5c43-33bb-4cb9-825f-6215275a17ca tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1406 microversion: 2.20 time: 0.354655 Sep 30 19:30:36.890610 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 157/293] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:30:36 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1406 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:30:37.495402 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-6c724478-e844-41eb-8ace-ec8e044dda11 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:37.496453 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-6c724478-e844-41eb-8ace-ec8e044dda11 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:37.527819 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6c724478-e844-41eb-8ace-ec8e044dda11 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:37.533265 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6c724478-e844-41eb-8ace-ec8e044dda11 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:37.542733 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6c724478-e844-41eb-8ace-ec8e044dda11 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:37.555807 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6c724478-e844-41eb-8ace-ec8e044dda11 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:37.560840 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6c724478-e844-41eb-8ace-ec8e044dda11 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:37.561753 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6c724478-e844-41eb-8ace-ec8e044dda11 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:37.911685 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-6c724478-e844-41eb-8ace-ec8e044dda11 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:37.915187 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-51e99b9c-8d9f-450c-b04d-cf0f5cefd715 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:37.915781 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-51e99b9c-8d9f-450c-b04d-cf0f5cefd715 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:37.935101 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-6c724478-e844-41eb-8ace-ec8e044dda11 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1517 microversion: 2.1 time: 0.462581 Sep 30 19:30:37.939869 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 137/294] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:37 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1517 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:30:37.949425 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-51e99b9c-8d9f-450c-b04d-cf0f5cefd715 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:37.950132 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-51e99b9c-8d9f-450c-b04d-cf0f5cefd715 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:37.950713 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-51e99b9c-8d9f-450c-b04d-cf0f5cefd715 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:37.951610 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-51e99b9c-8d9f-450c-b04d-cf0f5cefd715 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:37.952642 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-51e99b9c-8d9f-450c-b04d-cf0f5cefd715 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:37.953332 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-51e99b9c-8d9f-450c-b04d-cf0f5cefd715 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:37.967175 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-d9725c59-25fc-4fb2-8826-03d3f0753510 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:30:37.969578 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-d9725c59-25fc-4fb2-8826-03d3f0753510 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:37.981718 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d9725c59-25fc-4fb2-8826-03d3f0753510 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:37.982215 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d9725c59-25fc-4fb2-8826-03d3f0753510 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:37.982650 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d9725c59-25fc-4fb2-8826-03d3f0753510 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:37.983374 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d9725c59-25fc-4fb2-8826-03d3f0753510 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:37.983825 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d9725c59-25fc-4fb2-8826-03d3f0753510 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:37.984247 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d9725c59-25fc-4fb2-8826-03d3f0753510 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:38.044186 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.objects.instance [None req-d9725c59-25fc-4fb2-8826-03d3f0753510 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lazy-loading 'flavor' on Instance uuid 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 {{(pid=120648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 30 19:30:38.316334 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-51e99b9c-8d9f-450c-b04d-cf0f5cefd715 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:38.332843 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-51e99b9c-8d9f-450c-b04d-cf0f5cefd715 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:38.334735 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-d9725c59-25fc-4fb2-8826-03d3f0753510 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "POST /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31/action" status: 200 len: 32 microversion: 2.1 time: 0.372198 Sep 30 19:30:38.334885 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-51e99b9c-8d9f-450c-b04d-cf0f5cefd715 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:38.338242 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-51e99b9c-8d9f-450c-b04d-cf0f5cefd715 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1406 microversion: 2.20 time: 0.436945 Sep 30 19:30:38.338787 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 158/295] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:30:37 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1406 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:30:38.348165 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-589aff5f-8365-4697-a416-a4dc5f362c93 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:38.349175 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-589aff5f-8365-4697-a416-a4dc5f362c93 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:38.360445 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 138/296] 10.222.0.17 () {60 vars in 1278 bytes} [Fri Sep 30 19:30:37 2022] POST /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31/action => generated 32 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 30 19:30:38.365333 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-589aff5f-8365-4697-a416-a4dc5f362c93 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:38.366714 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-589aff5f-8365-4697-a416-a4dc5f362c93 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:38.367527 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-589aff5f-8365-4697-a416-a4dc5f362c93 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:38.368498 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-589aff5f-8365-4697-a416-a4dc5f362c93 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:38.369150 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-589aff5f-8365-4697-a416-a4dc5f362c93 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:38.370344 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-589aff5f-8365-4697-a416-a4dc5f362c93 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:38.595992 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-589aff5f-8365-4697-a416-a4dc5f362c93 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:38.608829 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-589aff5f-8365-4697-a416-a4dc5f362c93 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1523 microversion: 2.1 time: 0.266475 Sep 30 19:30:38.609700 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 159/297] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:38 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1523 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:30:39.370600 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-3269d2b1-ed4a-44d5-93d7-1204f82ab7d5 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:39.371923 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-3269d2b1-ed4a-44d5-93d7-1204f82ab7d5 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:39.390927 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3269d2b1-ed4a-44d5-93d7-1204f82ab7d5 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:39.391602 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3269d2b1-ed4a-44d5-93d7-1204f82ab7d5 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:39.403499 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3269d2b1-ed4a-44d5-93d7-1204f82ab7d5 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:39.405747 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3269d2b1-ed4a-44d5-93d7-1204f82ab7d5 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:39.406425 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3269d2b1-ed4a-44d5-93d7-1204f82ab7d5 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:39.408279 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3269d2b1-ed4a-44d5-93d7-1204f82ab7d5 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:39.798714 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-3269d2b1-ed4a-44d5-93d7-1204f82ab7d5 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:39.821788 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-3269d2b1-ed4a-44d5-93d7-1204f82ab7d5 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:39.823404 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-3269d2b1-ed4a-44d5-93d7-1204f82ab7d5 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:39.829414 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-3269d2b1-ed4a-44d5-93d7-1204f82ab7d5 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1406 microversion: 2.20 time: 0.463054 Sep 30 19:30:39.838685 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 139/298] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:30:39 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1406 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:30:39.851014 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-15395624-6d54-4fc4-9cf9-8ed5086df511 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:39.852294 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-15395624-6d54-4fc4-9cf9-8ed5086df511 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:39.867677 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-15395624-6d54-4fc4-9cf9-8ed5086df511 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:39.868899 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-15395624-6d54-4fc4-9cf9-8ed5086df511 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:39.870464 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-15395624-6d54-4fc4-9cf9-8ed5086df511 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:39.875182 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-15395624-6d54-4fc4-9cf9-8ed5086df511 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:39.878830 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-15395624-6d54-4fc4-9cf9-8ed5086df511 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:39.879323 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-15395624-6d54-4fc4-9cf9-8ed5086df511 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:40.154973 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-2c2637c8-3f38-413b-b31b-f002335a1995 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Action: 'create', calling method: .version_select at 0x7f621f387ee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1090227529", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+KMuXkLERpMy5nSHBrWOiQCDMLfdGvZh+6kN9GgULRXmfZ7wSlEnVYrBsGvuJ9BQ18Wp1OOFecAUDVHrPckJ6CtW/VvQyO+VblFRYGoXQSnZZruE4mvU27sJg0pkT7Iw=="}} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:30:40.215033 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.quota [None req-2c2637c8-3f38-413b-b31b-f002335a1995 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Getting quotas for project 4e940e1f7e3140f2865594bcdfc427a0. Resources: {'key_pairs'} {{(pid=120649) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 30 19:30:40.225572 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.quota [None req-2c2637c8-3f38-413b-b31b-f002335a1995 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Getting quotas for user 0e76ffd048d240ab94ee7e30b261d3cc and project 4e940e1f7e3140f2865594bcdfc427a0. Resources: {'key_pairs'} {{(pid=120649) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 30 19:30:40.266416 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-15395624-6d54-4fc4-9cf9-8ed5086df511 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:40.279311 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-15395624-6d54-4fc4-9cf9-8ed5086df511 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1523 microversion: 2.1 time: 0.437972 Sep 30 19:30:40.280331 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 140/299] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:39 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1523 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:30:40.291520 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-13baf6c9-c999-42a1-b956-a7e3fd950fde req-f45624c3-1c22-43ae-b5a9-faadadd2e26d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c87cf7d2-5d47-474b-b2f0-1ddc37bc97df", "name": "network-vif-plugged", "status": "completed", "tag": "408315e4-bcde-4577-8c32-5d47d233c194"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:30:40.318055 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-13baf6c9-c999-42a1-b956-a7e3fd950fde req-f45624c3-1c22-43ae-b5a9-faadadd2e26d service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:40.318611 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-13baf6c9-c999-42a1-b956-a7e3fd950fde req-f45624c3-1c22-43ae-b5a9-faadadd2e26d service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:40.319154 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-13baf6c9-c999-42a1-b956-a7e3fd950fde req-f45624c3-1c22-43ae-b5a9-faadadd2e26d service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:40.343997 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-2c2637c8-3f38-413b-b31b-f002335a1995 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.891901 Sep 30 19:30:40.351907 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-13baf6c9-c999-42a1-b956-a7e3fd950fde req-f45624c3-1c22-43ae-b5a9-faadadd2e26d service nova] Creating event network-vif-plugged:408315e4-bcde-4577-8c32-5d47d233c194 for instance c87cf7d2-5d47-474b-b2f0-1ddc37bc97df on hv-cinder-86001 Sep 30 19:30:40.352005 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 160/300] 10.222.0.17 () {60 vars in 1159 bytes} [Fri Sep 30 19:30:39 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:30:40.358356 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-13baf6c9-c999-42a1-b956-a7e3fd950fde req-f45624c3-1c22-43ae-b5a9-faadadd2e26d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076370 Sep 30 19:30:40.359248 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 141/301] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:30:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:30:40.870194 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-ffbe5cfe-ecd6-4abd-800a-ba6488fb74aa tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:40.871044 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-ffbe5cfe-ecd6-4abd-800a-ba6488fb74aa tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:40.878178 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ffbe5cfe-ecd6-4abd-800a-ba6488fb74aa tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:40.879399 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ffbe5cfe-ecd6-4abd-800a-ba6488fb74aa tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:40.880119 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ffbe5cfe-ecd6-4abd-800a-ba6488fb74aa tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:40.881538 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ffbe5cfe-ecd6-4abd-800a-ba6488fb74aa tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:40.882600 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ffbe5cfe-ecd6-4abd-800a-ba6488fb74aa tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:40.883365 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ffbe5cfe-ecd6-4abd-800a-ba6488fb74aa tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:41.304698 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-181b6c6e-e925-4f80-bdf6-2ac4946f6d5c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:41.306211 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-181b6c6e-e925-4f80-bdf6-2ac4946f6d5c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:41.324093 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-181b6c6e-e925-4f80-bdf6-2ac4946f6d5c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:41.326526 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-181b6c6e-e925-4f80-bdf6-2ac4946f6d5c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:41.327280 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-181b6c6e-e925-4f80-bdf6-2ac4946f6d5c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:41.329963 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-181b6c6e-e925-4f80-bdf6-2ac4946f6d5c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:41.334300 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-181b6c6e-e925-4f80-bdf6-2ac4946f6d5c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:41.337026 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-181b6c6e-e925-4f80-bdf6-2ac4946f6d5c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:41.583788 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-ffbe5cfe-ecd6-4abd-800a-ba6488fb74aa tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:41.596879 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-ffbe5cfe-ecd6-4abd-800a-ba6488fb74aa tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:41.601391 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-ffbe5cfe-ecd6-4abd-800a-ba6488fb74aa tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:41.603267 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-ffbe5cfe-ecd6-4abd-800a-ba6488fb74aa tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1406 microversion: 2.20 time: 0.737219 Sep 30 19:30:41.624418 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 161/302] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:30:40 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1406 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:30:41.781849 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-a7daa14c-6991-43b5-ac42-0f84f7895fa4 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:41.782414 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-a7daa14c-6991-43b5-ac42-0f84f7895fa4 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] [instance: 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:41.800968 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a7daa14c-6991-43b5-ac42-0f84f7895fa4 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:41.804186 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a7daa14c-6991-43b5-ac42-0f84f7895fa4 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:41.807073 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a7daa14c-6991-43b5-ac42-0f84f7895fa4 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:41.808479 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a7daa14c-6991-43b5-ac42-0f84f7895fa4 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:41.813087 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a7daa14c-6991-43b5-ac42-0f84f7895fa4 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:41.813728 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a7daa14c-6991-43b5-ac42-0f84f7895fa4 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:41.841732 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-181b6c6e-e925-4f80-bdf6-2ac4946f6d5c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:41.856586 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-181b6c6e-e925-4f80-bdf6-2ac4946f6d5c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1523 microversion: 2.1 time: 0.557030 Sep 30 19:30:41.857474 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 142/303] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:41 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1523 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:30:41.920050 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-a7daa14c-6991-43b5-ac42-0f84f7895fa4 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] [instance: 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf] Going to try to terminate instance {{(pid=120649) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 30 19:30:42.231692 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-a7daa14c-6991-43b5-ac42-0f84f7895fa4 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] 10.222.0.17 "DELETE /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf" status: 204 len: 0 microversion: 2.1 time: 0.455747 Sep 30 19:30:42.232987 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 162/304] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 30 19:30:41 2022] DELETE /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf => generated 0 bytes in 458 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 30 19:30:42.246112 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-de175925-137f-48fa-a4ff-3d589d08510e tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:42.247101 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-de175925-137f-48fa-a4ff-3d589d08510e tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] [instance: 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:42.253531 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-de175925-137f-48fa-a4ff-3d589d08510e tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:42.254019 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-de175925-137f-48fa-a4ff-3d589d08510e tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:42.254906 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-de175925-137f-48fa-a4ff-3d589d08510e tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:42.255845 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-de175925-137f-48fa-a4ff-3d589d08510e tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:42.257590 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-de175925-137f-48fa-a4ff-3d589d08510e tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:42.258224 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-de175925-137f-48fa-a4ff-3d589d08510e tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:42.570555 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-de175925-137f-48fa-a4ff-3d589d08510e tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bb718f9153493ca6dda343d461c5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9758637e30e4089b394ed6ea5c2cf3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:42.584313 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-de175925-137f-48fa-a4ff-3d589d08510e tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] 10.222.0.17 "GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf" status: 200 len: 1554 microversion: 2.1 time: 0.346310 Sep 30 19:30:42.607916 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 143/305] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:42 2022] GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf => generated 1554 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:30:42.634131 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-4e94dadb-3108-4520-a66b-0593d8e6e008 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:42.635427 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-4e94dadb-3108-4520-a66b-0593d8e6e008 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:42.643539 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4e94dadb-3108-4520-a66b-0593d8e6e008 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:42.644596 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4e94dadb-3108-4520-a66b-0593d8e6e008 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:42.648946 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4e94dadb-3108-4520-a66b-0593d8e6e008 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:42.649826 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4e94dadb-3108-4520-a66b-0593d8e6e008 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:42.651698 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4e94dadb-3108-4520-a66b-0593d8e6e008 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:42.652273 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4e94dadb-3108-4520-a66b-0593d8e6e008 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:42.885670 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-f72cdc46-5ba1-46a7-b0f3-44a013d82a3f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:42.886715 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-f72cdc46-5ba1-46a7-b0f3-44a013d82a3f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:42.894054 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f72cdc46-5ba1-46a7-b0f3-44a013d82a3f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:42.895370 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f72cdc46-5ba1-46a7-b0f3-44a013d82a3f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:42.896289 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f72cdc46-5ba1-46a7-b0f3-44a013d82a3f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:42.897463 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f72cdc46-5ba1-46a7-b0f3-44a013d82a3f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:42.898271 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f72cdc46-5ba1-46a7-b0f3-44a013d82a3f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:42.898758 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f72cdc46-5ba1-46a7-b0f3-44a013d82a3f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:42.989419 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-4e94dadb-3108-4520-a66b-0593d8e6e008 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:43.004517 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-4e94dadb-3108-4520-a66b-0593d8e6e008 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:43.006948 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-4e94dadb-3108-4520-a66b-0593d8e6e008 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:43.008203 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-4e94dadb-3108-4520-a66b-0593d8e6e008 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1406 microversion: 2.20 time: 0.378448 Sep 30 19:30:43.009001 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 163/306] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:30:42 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1406 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:30:43.148929 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f72cdc46-5ba1-46a7-b0f3-44a013d82a3f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:43.158953 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-f72cdc46-5ba1-46a7-b0f3-44a013d82a3f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1523 microversion: 2.1 time: 0.276997 Sep 30 19:30:43.159798 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 144/307] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:42 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1523 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:30:43.613649 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-d5781264-6fd5-4811-adf5-03a613b123ae tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:43.614603 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-d5781264-6fd5-4811-adf5-03a613b123ae tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] [instance: 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:43.621108 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d5781264-6fd5-4811-adf5-03a613b123ae tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:43.621865 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d5781264-6fd5-4811-adf5-03a613b123ae tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:43.622499 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d5781264-6fd5-4811-adf5-03a613b123ae tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:43.623397 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d5781264-6fd5-4811-adf5-03a613b123ae tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:43.624697 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d5781264-6fd5-4811-adf5-03a613b123ae tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:43.625338 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d5781264-6fd5-4811-adf5-03a613b123ae tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:43.829790 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-d5781264-6fd5-4811-adf5-03a613b123ae tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bb718f9153493ca6dda343d461c5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9758637e30e4089b394ed6ea5c2cf3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:43.840481 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-d5781264-6fd5-4811-adf5-03a613b123ae tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] 10.222.0.17 "GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf" status: 200 len: 1554 microversion: 2.1 time: 0.230553 Sep 30 19:30:43.842050 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 164/308] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:43 2022] GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf => generated 1554 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:30:44.045876 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-4cd35ba0-6811-4310-95df-7398e38f2d95 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:44.047335 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-4cd35ba0-6811-4310-95df-7398e38f2d95 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:44.063365 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4cd35ba0-6811-4310-95df-7398e38f2d95 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:44.064194 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4cd35ba0-6811-4310-95df-7398e38f2d95 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:44.064735 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4cd35ba0-6811-4310-95df-7398e38f2d95 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:44.065450 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4cd35ba0-6811-4310-95df-7398e38f2d95 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:44.066068 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4cd35ba0-6811-4310-95df-7398e38f2d95 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:44.066306 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4cd35ba0-6811-4310-95df-7398e38f2d95 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:44.184609 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-ad5538d9-f25e-4ba7-bec0-b8de29820871 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:44.185344 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-ad5538d9-f25e-4ba7-bec0-b8de29820871 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:44.195699 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ad5538d9-f25e-4ba7-bec0-b8de29820871 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:44.196229 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ad5538d9-f25e-4ba7-bec0-b8de29820871 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:44.198626 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ad5538d9-f25e-4ba7-bec0-b8de29820871 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:44.199601 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ad5538d9-f25e-4ba7-bec0-b8de29820871 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:44.200547 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ad5538d9-f25e-4ba7-bec0-b8de29820871 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:44.202378 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ad5538d9-f25e-4ba7-bec0-b8de29820871 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:44.285562 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-4cd35ba0-6811-4310-95df-7398e38f2d95 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:44.295217 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-4cd35ba0-6811-4310-95df-7398e38f2d95 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:44.297567 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-4cd35ba0-6811-4310-95df-7398e38f2d95 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:44.300280 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-4cd35ba0-6811-4310-95df-7398e38f2d95 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1406 microversion: 2.20 time: 0.264895 Sep 30 19:30:44.307129 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 145/309] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:30:44 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1406 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:30:44.655335 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-ad5538d9-f25e-4ba7-bec0-b8de29820871 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:44.665072 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-ad5538d9-f25e-4ba7-bec0-b8de29820871 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1523 microversion: 2.1 time: 0.484126 Sep 30 19:30:44.666088 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 165/310] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:44 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1523 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:30:44.872396 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-842502aa-0d8e-4f33-aaa3-250233b8d8b9 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:44.874241 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-842502aa-0d8e-4f33-aaa3-250233b8d8b9 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] [instance: 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:44.885934 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-842502aa-0d8e-4f33-aaa3-250233b8d8b9 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:44.886300 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-842502aa-0d8e-4f33-aaa3-250233b8d8b9 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:44.886897 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-842502aa-0d8e-4f33-aaa3-250233b8d8b9 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:44.887764 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-842502aa-0d8e-4f33-aaa3-250233b8d8b9 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:44.888333 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-842502aa-0d8e-4f33-aaa3-250233b8d8b9 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:44.888865 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-842502aa-0d8e-4f33-aaa3-250233b8d8b9 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:45.185785 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-842502aa-0d8e-4f33-aaa3-250233b8d8b9 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bb718f9153493ca6dda343d461c5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9758637e30e4089b394ed6ea5c2cf3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:45.194490 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-842502aa-0d8e-4f33-aaa3-250233b8d8b9 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] 10.222.0.17 "GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf" status: 200 len: 1554 microversion: 2.1 time: 0.333935 Sep 30 19:30:45.195053 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 146/311] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:44 2022] GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf => generated 1554 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:30:45.327777 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-95513022-8839-4ab9-81b8-a0b666b567cf tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:45.329067 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-95513022-8839-4ab9-81b8-a0b666b567cf tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:45.336043 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-95513022-8839-4ab9-81b8-a0b666b567cf tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:45.336561 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-95513022-8839-4ab9-81b8-a0b666b567cf tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:45.337455 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-95513022-8839-4ab9-81b8-a0b666b567cf tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:45.338369 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-95513022-8839-4ab9-81b8-a0b666b567cf tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:45.338813 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-95513022-8839-4ab9-81b8-a0b666b567cf tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:45.339482 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-95513022-8839-4ab9-81b8-a0b666b567cf tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:45.374324 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:45.592610 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-95513022-8839-4ab9-81b8-a0b666b567cf tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:45.605296 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-95513022-8839-4ab9-81b8-a0b666b567cf tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:45.606837 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-95513022-8839-4ab9-81b8-a0b666b567cf tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:45.608015 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-95513022-8839-4ab9-81b8-a0b666b567cf tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1597 microversion: 2.20 time: 0.285775 Sep 30 19:30:45.608693 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 166/312] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:30:45 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1597 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:30:45.634340 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-0dacab51-ac9a-46cd-9fca-359cd4de992f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:45.634843 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-0dacab51-ac9a-46cd-9fca-359cd4de992f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:45.641297 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0dacab51-ac9a-46cd-9fca-359cd4de992f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:45.641785 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0dacab51-ac9a-46cd-9fca-359cd4de992f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:45.642223 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0dacab51-ac9a-46cd-9fca-359cd4de992f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:45.643477 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0dacab51-ac9a-46cd-9fca-359cd4de992f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:45.643935 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0dacab51-ac9a-46cd-9fca-359cd4de992f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:45.644374 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0dacab51-ac9a-46cd-9fca-359cd4de992f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:45.690205 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-f26e3e6c-799d-48ea-9d8d-06f428714be2 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:45.691012 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-f26e3e6c-799d-48ea-9d8d-06f428714be2 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:45.704293 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f26e3e6c-799d-48ea-9d8d-06f428714be2 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:45.706241 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f26e3e6c-799d-48ea-9d8d-06f428714be2 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:45.706928 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f26e3e6c-799d-48ea-9d8d-06f428714be2 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:45.707996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f26e3e6c-799d-48ea-9d8d-06f428714be2 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:45.708719 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f26e3e6c-799d-48ea-9d8d-06f428714be2 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:45.709393 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f26e3e6c-799d-48ea-9d8d-06f428714be2 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:45.740997 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-0dacab51-ac9a-46cd-9fca-359cd4de992f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.109830 Sep 30 19:30:45.741671 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 147/313] 10.222.0.17 () {60 vars in 1316 bytes} [Fri Sep 30 19:30:45 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df/os-interface => generated 284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 30 19:30:45.990333 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-f26e3e6c-799d-48ea-9d8d-06f428714be2 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:45.999223 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-f26e3e6c-799d-48ea-9d8d-06f428714be2 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1523 microversion: 2.1 time: 0.313267 Sep 30 19:30:46.019619 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 167/314] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:45 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1523 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:30:46.219382 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-d72d50d5-deb2-4d3b-9e2f-bf337a3ff363 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:46.219969 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-d72d50d5-deb2-4d3b-9e2f-bf337a3ff363 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] [instance: 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:46.249335 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d72d50d5-deb2-4d3b-9e2f-bf337a3ff363 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:46.249929 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d72d50d5-deb2-4d3b-9e2f-bf337a3ff363 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:46.250609 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d72d50d5-deb2-4d3b-9e2f-bf337a3ff363 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:46.251516 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d72d50d5-deb2-4d3b-9e2f-bf337a3ff363 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:46.252220 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d72d50d5-deb2-4d3b-9e2f-bf337a3ff363 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:46.253798 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d72d50d5-deb2-4d3b-9e2f-bf337a3ff363 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:46.611599 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-d72d50d5-deb2-4d3b-9e2f-bf337a3ff363 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bb718f9153493ca6dda343d461c5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9758637e30e4089b394ed6ea5c2cf3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:46.632922 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-d72d50d5-deb2-4d3b-9e2f-bf337a3ff363 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] 10.222.0.17 "GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf" status: 200 len: 1554 microversion: 2.1 time: 0.415785 Sep 30 19:30:46.633811 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 148/315] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:46 2022] GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf => generated 1554 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:30:46.729509 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [req-00b3f86b-cbc2-4ed2-9eba-bcb9981ba4d0 req-61bc5b45-59d5-42b2-b426-62c534088255 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf", "name": "network-vif-deleted", "tag": "0898c149-da59-4f69-9cfb-2f5ece95d7bf"}]} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:30:46.737771 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:46.788529 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-00b3f86b-cbc2-4ed2-9eba-bcb9981ba4d0 req-61bc5b45-59d5-42b2-b426-62c534088255 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:46.789339 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-00b3f86b-cbc2-4ed2-9eba-bcb9981ba4d0 req-61bc5b45-59d5-42b2-b426-62c534088255 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:46.795637 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-00b3f86b-cbc2-4ed2-9eba-bcb9981ba4d0 req-61bc5b45-59d5-42b2-b426-62c534088255 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:46.822114 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.compute.server_external_events [req-00b3f86b-cbc2-4ed2-9eba-bcb9981ba4d0 req-61bc5b45-59d5-42b2-b426-62c534088255 service nova] Creating event network-vif-deleted:0898c149-da59-4f69-9cfb-2f5ece95d7bf for instance 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf on hv-cinder-86001 Sep 30 19:30:46.828778 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [req-00b3f86b-cbc2-4ed2-9eba-bcb9981ba4d0 req-61bc5b45-59d5-42b2-b426-62c534088255 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102553 Sep 30 19:30:46.829584 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 168/316] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:30:47.027455 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-5bb86011-161e-4d0c-8ac9-586769ebc6e4 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:47.028628 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-5bb86011-161e-4d0c-8ac9-586769ebc6e4 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:47.031182 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=65 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:47.051265 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5bb86011-161e-4d0c-8ac9-586769ebc6e4 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:47.051816 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5bb86011-161e-4d0c-8ac9-586769ebc6e4 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:47.052248 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5bb86011-161e-4d0c-8ac9-586769ebc6e4 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:47.055462 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5bb86011-161e-4d0c-8ac9-586769ebc6e4 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:47.057467 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5bb86011-161e-4d0c-8ac9-586769ebc6e4 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:47.058066 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5bb86011-161e-4d0c-8ac9-586769ebc6e4 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:47.105056 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:47.352325 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [req-5798a3f5-126a-4b01-969a-303e21b34e4f req-cb1b0304-6b6e-4b92-a1b5-4072f1e755a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c87cf7d2-5d47-474b-b2f0-1ddc37bc97df", "tag": "408315e4-bcde-4577-8c32-5d47d233c194"}]} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:30:47.364195 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-5798a3f5-126a-4b01-969a-303e21b34e4f req-cb1b0304-6b6e-4b92-a1b5-4072f1e755a0 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:47.364704 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-5798a3f5-126a-4b01-969a-303e21b34e4f req-cb1b0304-6b6e-4b92-a1b5-4072f1e755a0 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:47.365153 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-5798a3f5-126a-4b01-969a-303e21b34e4f req-cb1b0304-6b6e-4b92-a1b5-4072f1e755a0 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:47.394410 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.compute.server_external_events [req-5798a3f5-126a-4b01-969a-303e21b34e4f req-cb1b0304-6b6e-4b92-a1b5-4072f1e755a0 service nova] Creating event network-changed:408315e4-bcde-4577-8c32-5d47d233c194 for instance c87cf7d2-5d47-474b-b2f0-1ddc37bc97df on hv-cinder-86001 Sep 30 19:30:47.400788 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-5bb86011-161e-4d0c-8ac9-586769ebc6e4 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:47.406394 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [req-5798a3f5-126a-4b01-969a-303e21b34e4f req-cb1b0304-6b6e-4b92-a1b5-4072f1e755a0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058420 Sep 30 19:30:47.407201 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 169/317] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 30 19:30:47.419331 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-5bb86011-161e-4d0c-8ac9-586769ebc6e4 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1523 microversion: 2.1 time: 0.397652 Sep 30 19:30:47.420337 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 149/318] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:47 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1523 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:30:47.662572 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-7ead80da-6d90-4e5b-a5c8-d196678d0824 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:47.663454 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-7ead80da-6d90-4e5b-a5c8-d196678d0824 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] [instance: 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:47.672509 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7ead80da-6d90-4e5b-a5c8-d196678d0824 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:47.673194 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7ead80da-6d90-4e5b-a5c8-d196678d0824 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:47.673852 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7ead80da-6d90-4e5b-a5c8-d196678d0824 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:47.674780 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7ead80da-6d90-4e5b-a5c8-d196678d0824 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:47.675394 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7ead80da-6d90-4e5b-a5c8-d196678d0824 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:47.675973 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7ead80da-6d90-4e5b-a5c8-d196678d0824 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:47.744138 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7ead80da-6d90-4e5b-a5c8-d196678d0824 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:47.744810 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7ead80da-6d90-4e5b-a5c8-d196678d0824 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:47.745172 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7ead80da-6d90-4e5b-a5c8-d196678d0824 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:47.745660 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.objects.instance [None req-7ead80da-6d90-4e5b-a5c8-d196678d0824 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lazy-loading 'fault' on Instance uuid 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf {{(pid=120649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 30 19:30:47.839065 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-7ead80da-6d90-4e5b-a5c8-d196678d0824 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bb718f9153493ca6dda343d461c5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9758637e30e4089b394ed6ea5c2cf3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:47.865677 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-7ead80da-6d90-4e5b-a5c8-d196678d0824 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] 10.222.0.17 "GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf" status: 200 len: 1351 microversion: 2.1 time: 0.206061 Sep 30 19:30:47.865677 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 170/319] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:47 2022] GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf => generated 1351 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:30:48.447225 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-414f7195-75f3-4876-a296-e298d0a2b7ec tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:48.448481 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-414f7195-75f3-4876-a296-e298d0a2b7ec tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:48.461739 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-414f7195-75f3-4876-a296-e298d0a2b7ec tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:48.462520 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-414f7195-75f3-4876-a296-e298d0a2b7ec tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:48.462873 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-414f7195-75f3-4876-a296-e298d0a2b7ec tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:48.463959 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-414f7195-75f3-4876-a296-e298d0a2b7ec tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:48.464442 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-414f7195-75f3-4876-a296-e298d0a2b7ec tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:48.464871 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-414f7195-75f3-4876-a296-e298d0a2b7ec tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:48.696079 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-414f7195-75f3-4876-a296-e298d0a2b7ec tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:48.709949 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-414f7195-75f3-4876-a296-e298d0a2b7ec tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1523 microversion: 2.1 time: 0.270684 Sep 30 19:30:48.710860 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 150/320] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:48 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1523 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:30:48.890841 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-749e88fd-8a74-4d7f-932a-df382e3ffdec tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:48.891678 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-749e88fd-8a74-4d7f-932a-df382e3ffdec tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] [instance: 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:48.912970 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-749e88fd-8a74-4d7f-932a-df382e3ffdec tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:48.915870 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-749e88fd-8a74-4d7f-932a-df382e3ffdec tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:48.916531 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-749e88fd-8a74-4d7f-932a-df382e3ffdec tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:48.917611 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-749e88fd-8a74-4d7f-932a-df382e3ffdec tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:48.919566 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-749e88fd-8a74-4d7f-932a-df382e3ffdec tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:48.922662 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-749e88fd-8a74-4d7f-932a-df382e3ffdec tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:48.939788 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.wsgi [None req-749e88fd-8a74-4d7f-932a-df382e3ffdec tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] HTTP exception thrown: Instance 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf could not be found. Sep 30 19:30:48.952686 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-749e88fd-8a74-4d7f-932a-df382e3ffdec tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Request method failure captured: Sep 30 19:30:48.952686 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: request: GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf HTTP/1.1 Sep 30 19:30:48.952686 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Accept: application/json Sep 30 19:30:48.952686 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Accept-Encoding: identity Sep 30 19:30:48.952686 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Connection: close Sep 30 19:30:48.952686 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Content-Length: 0 Sep 30 19:30:48.952686 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Content-Type: application/json Sep 30 19:30:48.952686 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Host: 10.222.0.17 Sep 30 19:30:48.952686 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Openstack-System-Scope: None Sep 30 19:30:48.952686 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: User-Agent: python-urllib3/1.26.12 Sep 30 19:30:48.952686 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Auth-Token: gAAAAABjN0OHr1Is2muhbWTh-BL6g3W8u18dITPc4uVYqq-kAywE9-PRB6qeAuzssZ4u-ghUhnYK5hLRMHUtzGC8l9Yo0ZByRsyCqfROGrmCdUc6AbCIF7OoW-czXGS4BVjMPNceGhMo0roito9sGKwQOVl0kWDttLfteYYvew5NODgUN9hi5OI Sep 30 19:30:48.952686 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Domain-Id: None Sep 30 19:30:48.952686 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Domain-Name: None Sep 30 19:30:48.952686 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Identity-Status: Confirmed Sep 30 19:30:48.952686 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Is-Admin-Project: True Sep 30 19:30:48.952686 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Domain-Id: default Sep 30 19:30:48.952686 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Domain-Name: Default Sep 30 19:30:48.952686 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Id: d9758637e30e4089b394ed6ea5c2cf3f Sep 30 19:30:48.952686 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Name: tempest-DeleteServersTestJSON-540934009 Sep 30 19:30:48.952686 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Role: member,reader Sep 30 19:30:48.952686 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Roles: member,reader Sep 30 19:30:48.954111 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d9758637e30e4089b394ed6ea5c2cf3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d9758637e30e4089b394ed6ea5c2cf3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d9758637e30e4089b394ed6ea5c2cf3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d9758637e30e4089b394ed6ea5c2cf3f"}]}] Sep 30 19:30:48.954111 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant: tempest-DeleteServersTestJSON-540934009 Sep 30 19:30:48.954111 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant-Id: d9758637e30e4089b394ed6ea5c2cf3f Sep 30 19:30:48.954111 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant-Name: tempest-DeleteServersTestJSON-540934009 Sep 30 19:30:48.954111 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User: tempest-DeleteServersTestJSON-540934009-project Sep 30 19:30:48.954111 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Domain-Id: default Sep 30 19:30:48.954111 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Domain-Name: Default Sep 30 19:30:48.954111 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Id: f1bb718f9153493ca6dda343d461c5ab Sep 30 19:30:48.954111 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Name: tempest-DeleteServersTestJSON-540934009-project Sep 30 19:30:48.954111 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: method: > Sep 30 19:30:48.954111 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: exception: Instance 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf could not be found. Sep 30 19:30:48.954111 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: action_args: {'id': '85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf'} Sep 30 19:30:48.954887 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:30:48.954887 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:30:48.954887 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 30 19:30:48.954887 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 30 19:30:48.954887 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 30 19:30:48.954887 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 30 19:30:48.954887 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 30 19:30:48.954887 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 30 19:30:48.954887 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 30 19:30:48.954887 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 30 19:30:48.954887 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf could not be found. Sep 30 19:30:48.954887 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:30:48.954887 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:30:48.954887 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:30:48.954887 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:30:48.954887 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:30:48.954887 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:30:48.954887 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:30:48.954887 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:30:48.954887 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:30:48.957756 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:30:48.957756 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 30 19:30:48.957756 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 30 19:30:48.957756 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 30 19:30:48.957756 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 30 19:30:48.957756 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 30 19:30:48.957756 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 30 19:30:48.957756 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf could not be found. Sep 30 19:30:48.957756 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:30:48.957756 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:30:48.957756 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:30:48.957756 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:30:48.957756 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:30:48.957756 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:30:48.957756 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:30:48.957756 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:30:48.957756 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf could not be found. Sep 30 19:30:48.957756 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:30:48.960580 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-749e88fd-8a74-4d7f-932a-df382e3ffdec tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Returning 404 to user: Instance 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf could not be found. {{(pid=120649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:30:48.960580 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-749e88fd-8a74-4d7f-932a-df382e3ffdec tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] 10.222.0.17 "GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf" status: 404 len: 111 microversion: 2.1 time: 0.071233 Sep 30 19:30:48.960580 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 171/321] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:48 2022] GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 30 19:30:49.142175 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-6712402b-e88a-4de8-b8b6-5ae4bbdf485c tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:49.145251 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-6712402b-e88a-4de8-b8b6-5ae4bbdf485c tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] [instance: 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:49.151845 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6712402b-e88a-4de8-b8b6-5ae4bbdf485c tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:49.152566 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6712402b-e88a-4de8-b8b6-5ae4bbdf485c tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:49.153159 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6712402b-e88a-4de8-b8b6-5ae4bbdf485c tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:49.154039 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6712402b-e88a-4de8-b8b6-5ae4bbdf485c tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:49.154647 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6712402b-e88a-4de8-b8b6-5ae4bbdf485c tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:49.155417 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6712402b-e88a-4de8-b8b6-5ae4bbdf485c tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:49.168508 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.wsgi [None req-6712402b-e88a-4de8-b8b6-5ae4bbdf485c tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] HTTP exception thrown: Instance 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf could not be found. Sep 30 19:30:49.172640 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-6712402b-e88a-4de8-b8b6-5ae4bbdf485c tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Request method failure captured: Sep 30 19:30:49.172640 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: request: GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf/os-volume_attachments HTTP/1.1 Sep 30 19:30:49.172640 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 30 19:30:49.172640 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 30 19:30:49.172640 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Connection: close Sep 30 19:30:49.172640 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Length: 0 Sep 30 19:30:49.172640 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 30 19:30:49.172640 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Host: 10.222.0.17 Sep 30 19:30:49.172640 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 30 19:30:49.172640 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 30 19:30:49.172640 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjN0OHr1Is2muhbWTh-BL6g3W8u18dITPc4uVYqq-kAywE9-PRB6qeAuzssZ4u-ghUhnYK5hLRMHUtzGC8l9Yo0ZByRsyCqfROGrmCdUc6AbCIF7OoW-czXGS4BVjMPNceGhMo0roito9sGKwQOVl0kWDttLfteYYvew5NODgUN9hi5OI Sep 30 19:30:49.172640 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 30 19:30:49.172640 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 30 19:30:49.172640 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 30 19:30:49.172640 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 30 19:30:49.172640 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 30 19:30:49.172640 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 30 19:30:49.172640 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Id: d9758637e30e4089b394ed6ea5c2cf3f Sep 30 19:30:49.172640 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-DeleteServersTestJSON-540934009 Sep 30 19:30:49.172640 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 30 19:30:49.172640 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 30 19:30:49.174540 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d9758637e30e4089b394ed6ea5c2cf3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d9758637e30e4089b394ed6ea5c2cf3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d9758637e30e4089b394ed6ea5c2cf3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d9758637e30e4089b394ed6ea5c2cf3f"}]}] Sep 30 19:30:49.174540 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-DeleteServersTestJSON-540934009 Sep 30 19:30:49.174540 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Id: d9758637e30e4089b394ed6ea5c2cf3f Sep 30 19:30:49.174540 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-DeleteServersTestJSON-540934009 Sep 30 19:30:49.174540 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User: tempest-DeleteServersTestJSON-540934009-project Sep 30 19:30:49.174540 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 30 19:30:49.174540 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 30 19:30:49.174540 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Id: f1bb718f9153493ca6dda343d461c5ab Sep 30 19:30:49.174540 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-DeleteServersTestJSON-540934009-project Sep 30 19:30:49.174540 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: method: > Sep 30 19:30:49.174540 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: exception: Instance 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf could not be found. Sep 30 19:30:49.174540 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: action_args: {'server_id': '85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf'} Sep 30 19:30:49.175213 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:30:49.175213 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:30:49.175213 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 30 19:30:49.175213 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 30 19:30:49.175213 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 30 19:30:49.175213 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 30 19:30:49.175213 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 30 19:30:49.175213 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 30 19:30:49.175213 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 30 19:30:49.175213 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 30 19:30:49.175213 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf could not be found. Sep 30 19:30:49.175213 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:30:49.175213 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:30:49.175213 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:30:49.175213 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:30:49.175213 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:30:49.175213 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:30:49.175213 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:30:49.175213 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:30:49.175213 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:30:49.177199 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:30:49.177199 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 30 19:30:49.177199 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 30 19:30:49.177199 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 30 19:30:49.177199 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 30 19:30:49.177199 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 30 19:30:49.177199 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 30 19:30:49.177199 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 30 19:30:49.177199 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 30 19:30:49.177199 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf could not be found. Sep 30 19:30:49.177199 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:30:49.177199 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:30:49.177199 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:30:49.177199 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:30:49.177199 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:30:49.177199 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:30:49.177199 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:30:49.177199 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:30:49.177199 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf could not be found. Sep 30 19:30:49.177199 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:30:49.178739 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-6712402b-e88a-4de8-b8b6-5ae4bbdf485c tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Returning 404 to user: Instance 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf could not be found. {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:30:49.178739 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-6712402b-e88a-4de8-b8b6-5ae4bbdf485c tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] 10.222.0.17 "GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.037319 Sep 30 19:30:49.178739 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 151/322] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 30 19:30:49 2022] GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf/os-volume_attachments => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 30 19:30:49.734286 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-89189d4d-0d32-48a0-8eeb-006ced3e9d79 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:49.734907 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-89189d4d-0d32-48a0-8eeb-006ced3e9d79 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:49.741802 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-89189d4d-0d32-48a0-8eeb-006ced3e9d79 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:49.742366 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-89189d4d-0d32-48a0-8eeb-006ced3e9d79 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:49.742810 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-89189d4d-0d32-48a0-8eeb-006ced3e9d79 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:49.743501 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-89189d4d-0d32-48a0-8eeb-006ced3e9d79 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:49.743958 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-89189d4d-0d32-48a0-8eeb-006ced3e9d79 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:49.744401 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-89189d4d-0d32-48a0-8eeb-006ced3e9d79 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:49.883408 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-89189d4d-0d32-48a0-8eeb-006ced3e9d79 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:49.891149 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-89189d4d-0d32-48a0-8eeb-006ced3e9d79 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1523 microversion: 2.1 time: 0.160700 Sep 30 19:30:49.893973 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 172/323] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:49 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:30:50.458429 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-ce7c7163-bc7c-4f37-88a1-2ccf27248e62 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:50.459694 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-ce7c7163-bc7c-4f37-88a1-2ccf27248e62 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] [instance: 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:50.467355 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ce7c7163-bc7c-4f37-88a1-2ccf27248e62 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:50.467904 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ce7c7163-bc7c-4f37-88a1-2ccf27248e62 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:50.468347 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ce7c7163-bc7c-4f37-88a1-2ccf27248e62 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:50.469081 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ce7c7163-bc7c-4f37-88a1-2ccf27248e62 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:50.469573 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ce7c7163-bc7c-4f37-88a1-2ccf27248e62 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:50.470005 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ce7c7163-bc7c-4f37-88a1-2ccf27248e62 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:50.493651 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.wsgi [None req-ce7c7163-bc7c-4f37-88a1-2ccf27248e62 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] HTTP exception thrown: Instance 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf could not be found. Sep 30 19:30:50.495647 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-ce7c7163-bc7c-4f37-88a1-2ccf27248e62 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Request method failure captured: Sep 30 19:30:50.495647 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: request: DELETE /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf HTTP/1.1 Sep 30 19:30:50.495647 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 30 19:30:50.495647 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 30 19:30:50.495647 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Connection: close Sep 30 19:30:50.495647 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Length: 0 Sep 30 19:30:50.495647 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 30 19:30:50.495647 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Host: 10.222.0.17 Sep 30 19:30:50.495647 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 30 19:30:50.495647 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 30 19:30:50.495647 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjN0OHr1Is2muhbWTh-BL6g3W8u18dITPc4uVYqq-kAywE9-PRB6qeAuzssZ4u-ghUhnYK5hLRMHUtzGC8l9Yo0ZByRsyCqfROGrmCdUc6AbCIF7OoW-czXGS4BVjMPNceGhMo0roito9sGKwQOVl0kWDttLfteYYvew5NODgUN9hi5OI Sep 30 19:30:50.495647 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 30 19:30:50.495647 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 30 19:30:50.495647 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 30 19:30:50.495647 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 30 19:30:50.495647 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 30 19:30:50.495647 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 30 19:30:50.495647 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Id: d9758637e30e4089b394ed6ea5c2cf3f Sep 30 19:30:50.495647 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-DeleteServersTestJSON-540934009 Sep 30 19:30:50.495647 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 30 19:30:50.495647 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 30 19:30:50.497075 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d9758637e30e4089b394ed6ea5c2cf3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d9758637e30e4089b394ed6ea5c2cf3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d9758637e30e4089b394ed6ea5c2cf3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d9758637e30e4089b394ed6ea5c2cf3f"}]}] Sep 30 19:30:50.497075 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-DeleteServersTestJSON-540934009 Sep 30 19:30:50.497075 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Id: d9758637e30e4089b394ed6ea5c2cf3f Sep 30 19:30:50.497075 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-DeleteServersTestJSON-540934009 Sep 30 19:30:50.497075 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User: tempest-DeleteServersTestJSON-540934009-project Sep 30 19:30:50.497075 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 30 19:30:50.497075 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 30 19:30:50.497075 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Id: f1bb718f9153493ca6dda343d461c5ab Sep 30 19:30:50.497075 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-DeleteServersTestJSON-540934009-project Sep 30 19:30:50.497075 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: method: > Sep 30 19:30:50.497075 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: exception: Instance 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf could not be found. Sep 30 19:30:50.497075 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: action_args: {'id': '85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf'} Sep 30 19:30:50.497752 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:30:50.497752 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:30:50.497752 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 30 19:30:50.497752 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 30 19:30:50.497752 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 30 19:30:50.497752 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 30 19:30:50.497752 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 30 19:30:50.497752 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 30 19:30:50.497752 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 30 19:30:50.497752 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 30 19:30:50.497752 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf could not be found. Sep 30 19:30:50.497752 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:30:50.497752 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:30:50.497752 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:30:50.497752 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:30:50.497752 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:30:50.497752 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:30:50.497752 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:30:50.497752 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:30:50.497752 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:30:50.498874 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:30:50.498874 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 30 19:30:50.498874 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 30 19:30:50.498874 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 30 19:30:50.498874 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 30 19:30:50.498874 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 30 19:30:50.498874 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 30 19:30:50.498874 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 30 19:30:50.498874 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 30 19:30:50.498874 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf could not be found. Sep 30 19:30:50.498874 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:30:50.498874 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:30:50.498874 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:30:50.498874 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:30:50.498874 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:30:50.498874 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:30:50.498874 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:30:50.498874 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:30:50.498874 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf could not be found. Sep 30 19:30:50.498874 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:30:50.500020 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-ce7c7163-bc7c-4f37-88a1-2ccf27248e62 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Returning 404 to user: Instance 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf could not be found. {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:30:50.500020 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-ce7c7163-bc7c-4f37-88a1-2ccf27248e62 tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] 10.222.0.17 "DELETE /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf" status: 404 len: 111 microversion: 2.1 time: 0.043532 Sep 30 19:30:50.500020 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 152/324] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 30 19:30:50 2022] DELETE /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 30 19:30:50.506659 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-5bec1903-5f26-49e3-a7b1-16d1da8d23ad tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:50.507304 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-5bec1903-5f26-49e3-a7b1-16d1da8d23ad tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] [instance: 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:50.510239 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell0:SELECT=4 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:50.514535 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5bec1903-5f26-49e3-a7b1-16d1da8d23ad tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:50.515465 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5bec1903-5f26-49e3-a7b1-16d1da8d23ad tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:50.516201 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5bec1903-5f26-49e3-a7b1-16d1da8d23ad tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:50.517151 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5bec1903-5f26-49e3-a7b1-16d1da8d23ad tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:50.518307 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5bec1903-5f26-49e3-a7b1-16d1da8d23ad tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:50.518925 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5bec1903-5f26-49e3-a7b1-16d1da8d23ad tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:50.535165 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.wsgi [None req-5bec1903-5f26-49e3-a7b1-16d1da8d23ad tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] HTTP exception thrown: Instance 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf could not be found. Sep 30 19:30:50.537088 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-5bec1903-5f26-49e3-a7b1-16d1da8d23ad tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Request method failure captured: Sep 30 19:30:50.537088 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: request: GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf HTTP/1.1 Sep 30 19:30:50.537088 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Accept: application/json Sep 30 19:30:50.537088 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Accept-Encoding: identity Sep 30 19:30:50.537088 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Connection: close Sep 30 19:30:50.537088 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Content-Length: 0 Sep 30 19:30:50.537088 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Content-Type: application/json Sep 30 19:30:50.537088 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Host: 10.222.0.17 Sep 30 19:30:50.537088 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Openstack-System-Scope: None Sep 30 19:30:50.537088 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: User-Agent: python-urllib3/1.26.12 Sep 30 19:30:50.537088 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Auth-Token: gAAAAABjN0OHr1Is2muhbWTh-BL6g3W8u18dITPc4uVYqq-kAywE9-PRB6qeAuzssZ4u-ghUhnYK5hLRMHUtzGC8l9Yo0ZByRsyCqfROGrmCdUc6AbCIF7OoW-czXGS4BVjMPNceGhMo0roito9sGKwQOVl0kWDttLfteYYvew5NODgUN9hi5OI Sep 30 19:30:50.537088 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Domain-Id: None Sep 30 19:30:50.537088 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Domain-Name: None Sep 30 19:30:50.537088 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Identity-Status: Confirmed Sep 30 19:30:50.537088 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Is-Admin-Project: True Sep 30 19:30:50.537088 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Domain-Id: default Sep 30 19:30:50.537088 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Domain-Name: Default Sep 30 19:30:50.537088 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Id: d9758637e30e4089b394ed6ea5c2cf3f Sep 30 19:30:50.537088 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Name: tempest-DeleteServersTestJSON-540934009 Sep 30 19:30:50.537088 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Role: member,reader Sep 30 19:30:50.537088 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Roles: member,reader Sep 30 19:30:50.538324 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d9758637e30e4089b394ed6ea5c2cf3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d9758637e30e4089b394ed6ea5c2cf3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d9758637e30e4089b394ed6ea5c2cf3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d9758637e30e4089b394ed6ea5c2cf3f"}]}] Sep 30 19:30:50.538324 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant: tempest-DeleteServersTestJSON-540934009 Sep 30 19:30:50.538324 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant-Id: d9758637e30e4089b394ed6ea5c2cf3f Sep 30 19:30:50.538324 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant-Name: tempest-DeleteServersTestJSON-540934009 Sep 30 19:30:50.538324 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User: tempest-DeleteServersTestJSON-540934009-project Sep 30 19:30:50.538324 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Domain-Id: default Sep 30 19:30:50.538324 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Domain-Name: Default Sep 30 19:30:50.538324 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Id: f1bb718f9153493ca6dda343d461c5ab Sep 30 19:30:50.538324 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Name: tempest-DeleteServersTestJSON-540934009-project Sep 30 19:30:50.538324 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: method: > Sep 30 19:30:50.538324 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: exception: Instance 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf could not be found. Sep 30 19:30:50.538324 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: action_args: {'id': '85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf'} Sep 30 19:30:50.539007 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:30:50.539007 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:30:50.539007 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 30 19:30:50.539007 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 30 19:30:50.539007 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 30 19:30:50.539007 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 30 19:30:50.539007 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 30 19:30:50.539007 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 30 19:30:50.539007 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 30 19:30:50.539007 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 30 19:30:50.539007 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf could not be found. Sep 30 19:30:50.539007 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:30:50.539007 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:30:50.539007 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:30:50.539007 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:30:50.539007 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:30:50.539007 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:30:50.539007 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:30:50.539007 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:30:50.539007 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:30:50.540148 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:30:50.540148 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 30 19:30:50.540148 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 30 19:30:50.540148 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 30 19:30:50.540148 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 30 19:30:50.540148 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 30 19:30:50.540148 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 30 19:30:50.540148 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf could not be found. Sep 30 19:30:50.540148 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:30:50.540148 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:30:50.540148 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:30:50.540148 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:30:50.540148 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:30:50.540148 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:30:50.540148 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:30:50.540148 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:30:50.540148 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf could not be found. Sep 30 19:30:50.540148 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:30:50.542735 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-5bec1903-5f26-49e3-a7b1-16d1da8d23ad tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] Returning 404 to user: Instance 85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf could not be found. {{(pid=120649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:30:50.544227 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-5bec1903-5f26-49e3-a7b1-16d1da8d23ad tempest-DeleteServersTestJSON-540934009 tempest-DeleteServersTestJSON-540934009-project] 10.222.0.17 "GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf" status: 404 len: 111 microversion: 2.1 time: 0.040751 Sep 30 19:30:50.545143 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 173/325] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:50 2022] GET /compute/v2.1/servers/85e909d7-7ff4-4f1d-a7cb-f0b0ca75bccf => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 30 19:30:50.917140 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-24730271-f1dd-49e9-8cfd-2b0c732eae19 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:50.917763 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-24730271-f1dd-49e9-8cfd-2b0c732eae19 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:50.927575 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-24730271-f1dd-49e9-8cfd-2b0c732eae19 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:50.928102 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-24730271-f1dd-49e9-8cfd-2b0c732eae19 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:50.928586 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-24730271-f1dd-49e9-8cfd-2b0c732eae19 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:50.929347 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-24730271-f1dd-49e9-8cfd-2b0c732eae19 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:50.945660 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-24730271-f1dd-49e9-8cfd-2b0c732eae19 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:50.946413 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-24730271-f1dd-49e9-8cfd-2b0c732eae19 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:51.181831 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-24730271-f1dd-49e9-8cfd-2b0c732eae19 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:51.198420 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-24730271-f1dd-49e9-8cfd-2b0c732eae19 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1523 microversion: 2.1 time: 0.285917 Sep 30 19:30:51.199668 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 153/326] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:50 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1523 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:30:52.228165 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-0dcba301-5330-4ef9-8763-391384bc3307 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:52.230428 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-0dcba301-5330-4ef9-8763-391384bc3307 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:52.243122 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0dcba301-5330-4ef9-8763-391384bc3307 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:52.243723 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0dcba301-5330-4ef9-8763-391384bc3307 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:52.244236 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0dcba301-5330-4ef9-8763-391384bc3307 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:52.245117 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0dcba301-5330-4ef9-8763-391384bc3307 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:52.245640 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0dcba301-5330-4ef9-8763-391384bc3307 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:52.246311 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0dcba301-5330-4ef9-8763-391384bc3307 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:52.732122 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-0dcba301-5330-4ef9-8763-391384bc3307 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:52.743175 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-0dcba301-5330-4ef9-8763-391384bc3307 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1523 microversion: 2.1 time: 0.524287 Sep 30 19:30:52.743750 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 174/327] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:52 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1523 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:30:53.769521 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-c37ce750-3ead-405a-ac75-9194b2b43f20 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:53.770161 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-c37ce750-3ead-405a-ac75-9194b2b43f20 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:53.780211 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c37ce750-3ead-405a-ac75-9194b2b43f20 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:53.780978 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c37ce750-3ead-405a-ac75-9194b2b43f20 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:53.781481 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c37ce750-3ead-405a-ac75-9194b2b43f20 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:53.782262 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c37ce750-3ead-405a-ac75-9194b2b43f20 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:53.782844 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c37ce750-3ead-405a-ac75-9194b2b43f20 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:53.783484 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c37ce750-3ead-405a-ac75-9194b2b43f20 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:53.988288 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-c37ce750-3ead-405a-ac75-9194b2b43f20 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:53.995952 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-c37ce750-3ead-405a-ac75-9194b2b43f20 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1523 microversion: 2.1 time: 0.233234 Sep 30 19:30:53.996551 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 154/328] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:53 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1523 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:30:55.020338 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-63f24c06-a65c-489d-b7e2-78854705a7ab tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:55.021915 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-63f24c06-a65c-489d-b7e2-78854705a7ab tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:55.030955 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-63f24c06-a65c-489d-b7e2-78854705a7ab tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:55.031884 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-63f24c06-a65c-489d-b7e2-78854705a7ab tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:55.032618 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-63f24c06-a65c-489d-b7e2-78854705a7ab tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:55.033527 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-63f24c06-a65c-489d-b7e2-78854705a7ab tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:55.034511 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-63f24c06-a65c-489d-b7e2-78854705a7ab tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:55.035125 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-63f24c06-a65c-489d-b7e2-78854705a7ab tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:55.226110 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-63f24c06-a65c-489d-b7e2-78854705a7ab tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:55.239952 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-63f24c06-a65c-489d-b7e2-78854705a7ab tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1523 microversion: 2.1 time: 0.224972 Sep 30 19:30:55.240542 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 175/329] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:55 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1523 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:30:56.265420 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-abe99b4d-a461-454d-8a28-e93f701c94cb tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:56.265974 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-abe99b4d-a461-454d-8a28-e93f701c94cb tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:56.272535 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-abe99b4d-a461-454d-8a28-e93f701c94cb tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:56.273019 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-abe99b4d-a461-454d-8a28-e93f701c94cb tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:56.273466 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-abe99b4d-a461-454d-8a28-e93f701c94cb tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:56.274162 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-abe99b4d-a461-454d-8a28-e93f701c94cb tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:56.274634 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-abe99b4d-a461-454d-8a28-e93f701c94cb tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:56.275066 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-abe99b4d-a461-454d-8a28-e93f701c94cb tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:56.417905 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-abe99b4d-a461-454d-8a28-e93f701c94cb tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:56.426805 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-abe99b4d-a461-454d-8a28-e93f701c94cb tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1523 microversion: 2.1 time: 0.165296 Sep 30 19:30:56.427443 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 155/330] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:56 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:30:57.449409 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-c7c0ad5a-ab49-43e9-b387-1daf5e41b9bc tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:57.450028 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-c7c0ad5a-ab49-43e9-b387-1daf5e41b9bc tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:57.456822 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c7c0ad5a-ab49-43e9-b387-1daf5e41b9bc tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:57.457311 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c7c0ad5a-ab49-43e9-b387-1daf5e41b9bc tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:57.457754 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c7c0ad5a-ab49-43e9-b387-1daf5e41b9bc tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:57.458449 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c7c0ad5a-ab49-43e9-b387-1daf5e41b9bc tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:57.459078 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c7c0ad5a-ab49-43e9-b387-1daf5e41b9bc tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:57.459509 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c7c0ad5a-ab49-43e9-b387-1daf5e41b9bc tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:57.598793 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-c7c0ad5a-ab49-43e9-b387-1daf5e41b9bc tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:57.606633 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-c7c0ad5a-ab49-43e9-b387-1daf5e41b9bc tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1523 microversion: 2.1 time: 0.161119 Sep 30 19:30:57.607186 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 176/331] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:57 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:30:58.628697 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-b6875ca7-2b38-477c-a5e6-a9fa3b1f4087 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:58.629889 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-b6875ca7-2b38-477c-a5e6-a9fa3b1f4087 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:58.643017 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b6875ca7-2b38-477c-a5e6-a9fa3b1f4087 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:58.643503 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b6875ca7-2b38-477c-a5e6-a9fa3b1f4087 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:58.643934 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b6875ca7-2b38-477c-a5e6-a9fa3b1f4087 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:58.644662 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b6875ca7-2b38-477c-a5e6-a9fa3b1f4087 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:58.645115 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b6875ca7-2b38-477c-a5e6-a9fa3b1f4087 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:58.645552 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b6875ca7-2b38-477c-a5e6-a9fa3b1f4087 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:58.780696 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-b6875ca7-2b38-477c-a5e6-a9fa3b1f4087 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:30:58.789981 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-b6875ca7-2b38-477c-a5e6-a9fa3b1f4087 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1523 microversion: 2.1 time: 0.165454 Sep 30 19:30:58.790548 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 156/332] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:58 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:30:59.814763 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-70278181-2847-4b8d-a81e-46eedd3b5a93 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:30:59.814763 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-70278181-2847-4b8d-a81e-46eedd3b5a93 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:30:59.824642 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-70278181-2847-4b8d-a81e-46eedd3b5a93 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:59.825531 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-70278181-2847-4b8d-a81e-46eedd3b5a93 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:59.828527 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-70278181-2847-4b8d-a81e-46eedd3b5a93 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:30:59.829698 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-70278181-2847-4b8d-a81e-46eedd3b5a93 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:30:59.832037 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-70278181-2847-4b8d-a81e-46eedd3b5a93 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:30:59.833020 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-70278181-2847-4b8d-a81e-46eedd3b5a93 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:00.021010 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-70278181-2847-4b8d-a81e-46eedd3b5a93 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:00.028848 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-70278181-2847-4b8d-a81e-46eedd3b5a93 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1523 microversion: 2.1 time: 0.219531 Sep 30 19:31:00.029455 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 177/333] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:30:59 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1523 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:01.062174 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-0de5d5ab-b04e-44a5-b885-0f4b6f054e04 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:01.063023 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-0de5d5ab-b04e-44a5-b885-0f4b6f054e04 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:01.069792 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0de5d5ab-b04e-44a5-b885-0f4b6f054e04 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:01.070361 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0de5d5ab-b04e-44a5-b885-0f4b6f054e04 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:01.070975 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0de5d5ab-b04e-44a5-b885-0f4b6f054e04 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:01.071771 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0de5d5ab-b04e-44a5-b885-0f4b6f054e04 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:01.072323 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0de5d5ab-b04e-44a5-b885-0f4b6f054e04 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:01.072872 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0de5d5ab-b04e-44a5-b885-0f4b6f054e04 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:01.210018 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-0de5d5ab-b04e-44a5-b885-0f4b6f054e04 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:01.217879 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-0de5d5ab-b04e-44a5-b885-0f4b6f054e04 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1523 microversion: 2.1 time: 0.160378 Sep 30 19:31:01.218444 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 157/334] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:01 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:31:02.241268 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-a3656763-d4a0-4dcd-81ea-2fbac91bb890 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:02.241906 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-a3656763-d4a0-4dcd-81ea-2fbac91bb890 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:02.248100 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a3656763-d4a0-4dcd-81ea-2fbac91bb890 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:02.248890 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a3656763-d4a0-4dcd-81ea-2fbac91bb890 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:02.249326 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a3656763-d4a0-4dcd-81ea-2fbac91bb890 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:02.250014 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a3656763-d4a0-4dcd-81ea-2fbac91bb890 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:02.250518 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a3656763-d4a0-4dcd-81ea-2fbac91bb890 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:02.250948 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a3656763-d4a0-4dcd-81ea-2fbac91bb890 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:02.393938 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-a3656763-d4a0-4dcd-81ea-2fbac91bb890 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:02.401877 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-a3656763-d4a0-4dcd-81ea-2fbac91bb890 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1523 microversion: 2.1 time: 0.164446 Sep 30 19:31:02.402707 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 178/335] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:02 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:03.269821 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-35585ec6-d8c8-42e2-a10a-8505bd5e39bf tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-756851625", "imageRef": "7714d055-7d2c-4f56-9b14-45324361e286", "flavorRef": "452", "networks": [{"uuid": "31acc055-7d21-4cd0-ab1f-5c4c3adcffb8"}]}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:31:03.324172 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.network.neutron [None req-35585ec6-d8c8-42e2-a10a-8505bd5e39bf tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] validate_networks() for [('31acc055-7d21-4cd0-ab1f-5c4c3adcffb8', None, None, None, None, None)] {{(pid=120648) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 30 19:31:03.427204 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-f89f10dd-33b7-4680-bfcf-81fdabddb03a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:03.427884 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-f89f10dd-33b7-4680-bfcf-81fdabddb03a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:03.434176 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f89f10dd-33b7-4680-bfcf-81fdabddb03a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:03.434813 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f89f10dd-33b7-4680-bfcf-81fdabddb03a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:03.435576 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f89f10dd-33b7-4680-bfcf-81fdabddb03a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:03.436842 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f89f10dd-33b7-4680-bfcf-81fdabddb03a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:03.437635 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f89f10dd-33b7-4680-bfcf-81fdabddb03a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:03.438383 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f89f10dd-33b7-4680-bfcf-81fdabddb03a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:03.577533 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-f89f10dd-33b7-4680-bfcf-81fdabddb03a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:03.585654 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-f89f10dd-33b7-4680-bfcf-81fdabddb03a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1523 microversion: 2.1 time: 0.162926 Sep 30 19:31:03.586214 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 179/336] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:03 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:31:03.699659 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-35585ec6-d8c8-42e2-a10a-8505bd5e39bf tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Flavor limits 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 30 19:31:03.700083 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-35585ec6-d8c8-42e2-a10a-8505bd5e39bf tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Image limits 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 30 19:31:03.700625 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-35585ec6-d8c8-42e2-a10a-8505bd5e39bf tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Flavor pref 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 30 19:31:03.701028 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-35585ec6-d8c8-42e2-a10a-8505bd5e39bf tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Image pref 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 30 19:31:03.701436 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-35585ec6-d8c8-42e2-a10a-8505bd5e39bf tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 30 19:31:03.710631 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-35585ec6-d8c8-42e2-a10a-8505bd5e39bf tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:03.711107 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-35585ec6-d8c8-42e2-a10a-8505bd5e39bf tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:03.711534 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-35585ec6-d8c8-42e2-a10a-8505bd5e39bf tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:03.712324 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-35585ec6-d8c8-42e2-a10a-8505bd5e39bf tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:03.712805 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-35585ec6-d8c8-42e2-a10a-8505bd5e39bf tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:03.713322 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-35585ec6-d8c8-42e2-a10a-8505bd5e39bf tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:03.730642 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-35585ec6-d8c8-42e2-a10a-8505bd5e39bf tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Getting quotas for project 08e6fee821e7449b92c3df24de169fbc. Resources: {'instances', 'ram', 'cores'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 30 19:31:03.734443 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-35585ec6-d8c8-42e2-a10a-8505bd5e39bf tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Getting quotas for user 139dfba82fda43f1a058c60b1a4dc818 and project 08e6fee821e7449b92c3df24de169fbc. Resources: {'instances', 'ram', 'cores'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 30 19:31:03.745664 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-35585ec6-d8c8-42e2-a10a-8505bd5e39bf tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Going to run 1 instances... {{(pid=120648) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 30 19:31:03.747896 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-35585ec6-d8c8-42e2-a10a-8505bd5e39bf tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 0d0d6662-98d6-49c6-9149-0f8c4acd0350] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7714d055-7d2c-4f56-9b14-45324361e286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 30 19:31:03.797448 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-35585ec6-d8c8-42e2-a10a-8505bd5e39bf tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.532206 Sep 30 19:31:03.798081 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 158/337] 10.222.0.17 () {60 vars in 1147 bytes} [Fri Sep 30 19:31:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 534 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 30 19:31:03.809475 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-a039ff63-9067-4e1f-bd46-a87654e157d6 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:03.810089 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-a039ff63-9067-4e1f-bd46-a87654e157d6 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 0d0d6662-98d6-49c6-9149-0f8c4acd0350] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:03.867395 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-a039ff63-9067-4e1f-bd46-a87654e157d6 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139dfba82fda43f1a058c60b1a4dc818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e6fee821e7449b92c3df24de169fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:03.874201 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-a039ff63-9067-4e1f-bd46-a87654e157d6 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] 10.222.0.17 "GET /compute/v2.1/servers/0d0d6662-98d6-49c6-9149-0f8c4acd0350" status: 200 len: 1213 microversion: 2.1 time: 0.068527 Sep 30 19:31:03.874818 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 180/338] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:03 2022] GET /compute/v2.1/servers/0d0d6662-98d6-49c6-9149-0f8c4acd0350 => generated 1213 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:04.610090 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-0a62f384-5786-46e3-a8ea-f8da142d263d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:04.612025 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-0a62f384-5786-46e3-a8ea-f8da142d263d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:04.619666 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0a62f384-5786-46e3-a8ea-f8da142d263d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:04.620169 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0a62f384-5786-46e3-a8ea-f8da142d263d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:04.620635 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0a62f384-5786-46e3-a8ea-f8da142d263d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:04.621349 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0a62f384-5786-46e3-a8ea-f8da142d263d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:04.621804 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0a62f384-5786-46e3-a8ea-f8da142d263d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:04.622462 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0a62f384-5786-46e3-a8ea-f8da142d263d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:04.774035 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-0a62f384-5786-46e3-a8ea-f8da142d263d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:04.783914 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-0a62f384-5786-46e3-a8ea-f8da142d263d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1523 microversion: 2.1 time: 0.178070 Sep 30 19:31:04.785714 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 159/339] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:04 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1523 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:04.896480 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-d417762a-fd2a-4602-bf3f-02b6f946edd2 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:04.897089 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-d417762a-fd2a-4602-bf3f-02b6f946edd2 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 0d0d6662-98d6-49c6-9149-0f8c4acd0350] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:04.902851 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d417762a-fd2a-4602-bf3f-02b6f946edd2 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:04.903330 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d417762a-fd2a-4602-bf3f-02b6f946edd2 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:04.903760 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d417762a-fd2a-4602-bf3f-02b6f946edd2 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:04.904475 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d417762a-fd2a-4602-bf3f-02b6f946edd2 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:04.904933 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d417762a-fd2a-4602-bf3f-02b6f946edd2 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:04.905353 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d417762a-fd2a-4602-bf3f-02b6f946edd2 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:04.966036 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-d417762a-fd2a-4602-bf3f-02b6f946edd2 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139dfba82fda43f1a058c60b1a4dc818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e6fee821e7449b92c3df24de169fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:04.973596 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-d417762a-fd2a-4602-bf3f-02b6f946edd2 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] 10.222.0.17 "GET /compute/v2.1/servers/0d0d6662-98d6-49c6-9149-0f8c4acd0350" status: 200 len: 1265 microversion: 2.1 time: 0.081083 Sep 30 19:31:04.974147 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 181/340] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:04 2022] GET /compute/v2.1/servers/0d0d6662-98d6-49c6-9149-0f8c4acd0350 => generated 1265 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:05.811455 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-484865a3-3106-4d39-8c58-0cc73b5a44bf tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:05.812116 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-484865a3-3106-4d39-8c58-0cc73b5a44bf tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:05.819939 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-484865a3-3106-4d39-8c58-0cc73b5a44bf tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:05.820552 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-484865a3-3106-4d39-8c58-0cc73b5a44bf tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:05.821427 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-484865a3-3106-4d39-8c58-0cc73b5a44bf tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:05.822740 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-484865a3-3106-4d39-8c58-0cc73b5a44bf tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:05.823177 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-484865a3-3106-4d39-8c58-0cc73b5a44bf tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:05.824049 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-484865a3-3106-4d39-8c58-0cc73b5a44bf tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:05.967242 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-484865a3-3106-4d39-8c58-0cc73b5a44bf tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:05.979693 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-484865a3-3106-4d39-8c58-0cc73b5a44bf tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1523 microversion: 2.1 time: 0.173166 Sep 30 19:31:05.980257 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 160/341] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:05 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:05.997095 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-bd16a346-32fe-4cfe-add4-3f164fcd0e57 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:05.998477 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-bd16a346-32fe-4cfe-add4-3f164fcd0e57 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 0d0d6662-98d6-49c6-9149-0f8c4acd0350] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:06.004978 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-bd16a346-32fe-4cfe-add4-3f164fcd0e57 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:06.005631 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-bd16a346-32fe-4cfe-add4-3f164fcd0e57 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:06.006069 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-bd16a346-32fe-4cfe-add4-3f164fcd0e57 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:06.006766 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-bd16a346-32fe-4cfe-add4-3f164fcd0e57 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:06.007215 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-bd16a346-32fe-4cfe-add4-3f164fcd0e57 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:06.007637 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-bd16a346-32fe-4cfe-add4-3f164fcd0e57 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:06.257378 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-bd16a346-32fe-4cfe-add4-3f164fcd0e57 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139dfba82fda43f1a058c60b1a4dc818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e6fee821e7449b92c3df24de169fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:06.266536 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-bd16a346-32fe-4cfe-add4-3f164fcd0e57 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] 10.222.0.17 "GET /compute/v2.1/servers/0d0d6662-98d6-49c6-9149-0f8c4acd0350" status: 200 len: 1313 microversion: 2.1 time: 0.273479 Sep 30 19:31:06.281486 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 182/342] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:05 2022] GET /compute/v2.1/servers/0d0d6662-98d6-49c6-9149-0f8c4acd0350 => generated 1313 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:06.702133 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-b0667ad1-7b6c-4a17-866c-7ab666153b4c req-be97ec2b-4a09-44cd-b37b-9e52150043bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d0d6662-98d6-49c6-9149-0f8c4acd0350", "tag": "8ddd7bb7-11e2-44a4-9c7c-df0c58a2ab6d"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:31:06.715971 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-b0667ad1-7b6c-4a17-866c-7ab666153b4c req-be97ec2b-4a09-44cd-b37b-9e52150043bc service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:06.716632 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-b0667ad1-7b6c-4a17-866c-7ab666153b4c req-be97ec2b-4a09-44cd-b37b-9e52150043bc service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:06.717074 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-b0667ad1-7b6c-4a17-866c-7ab666153b4c req-be97ec2b-4a09-44cd-b37b-9e52150043bc service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:06.730405 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-b0667ad1-7b6c-4a17-866c-7ab666153b4c req-be97ec2b-4a09-44cd-b37b-9e52150043bc service nova] Creating event network-changed:8ddd7bb7-11e2-44a4-9c7c-df0c58a2ab6d for instance 0d0d6662-98d6-49c6-9149-0f8c4acd0350 on hv-cinder-86001 Sep 30 19:31:06.741155 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-b0667ad1-7b6c-4a17-866c-7ab666153b4c req-be97ec2b-4a09-44cd-b37b-9e52150043bc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043076 Sep 30 19:31:06.742230 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 161/343] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:31:07.003439 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-b620079f-a852-492b-8cde-7e81d0e3d9a2 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:07.004243 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-b620079f-a852-492b-8cde-7e81d0e3d9a2 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:07.011349 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b620079f-a852-492b-8cde-7e81d0e3d9a2 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:07.011870 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b620079f-a852-492b-8cde-7e81d0e3d9a2 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:07.012321 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b620079f-a852-492b-8cde-7e81d0e3d9a2 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:07.013060 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b620079f-a852-492b-8cde-7e81d0e3d9a2 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:07.013521 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b620079f-a852-492b-8cde-7e81d0e3d9a2 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:07.013954 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b620079f-a852-492b-8cde-7e81d0e3d9a2 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:07.218121 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-b620079f-a852-492b-8cde-7e81d0e3d9a2 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:07.226765 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-b620079f-a852-492b-8cde-7e81d0e3d9a2 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1523 microversion: 2.1 time: 0.227793 Sep 30 19:31:07.227369 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 183/344] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:06 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1523 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:07.294036 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-a6e739a5-6edf-4bf8-b7cc-b9d8b1d81f29 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:07.294036 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-a6e739a5-6edf-4bf8-b7cc-b9d8b1d81f29 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 0d0d6662-98d6-49c6-9149-0f8c4acd0350] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:07.301731 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a6e739a5-6edf-4bf8-b7cc-b9d8b1d81f29 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:07.302355 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a6e739a5-6edf-4bf8-b7cc-b9d8b1d81f29 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:07.302892 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a6e739a5-6edf-4bf8-b7cc-b9d8b1d81f29 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:07.303669 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a6e739a5-6edf-4bf8-b7cc-b9d8b1d81f29 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:07.304308 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a6e739a5-6edf-4bf8-b7cc-b9d8b1d81f29 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:07.304856 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a6e739a5-6edf-4bf8-b7cc-b9d8b1d81f29 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:07.446938 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-a6e739a5-6edf-4bf8-b7cc-b9d8b1d81f29 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139dfba82fda43f1a058c60b1a4dc818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e6fee821e7449b92c3df24de169fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:07.455627 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-a6e739a5-6edf-4bf8-b7cc-b9d8b1d81f29 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] 10.222.0.17 "GET /compute/v2.1/servers/0d0d6662-98d6-49c6-9149-0f8c4acd0350" status: 200 len: 1313 microversion: 2.1 time: 0.168103 Sep 30 19:31:07.456189 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 162/345] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:07 2022] GET /compute/v2.1/servers/0d0d6662-98d6-49c6-9149-0f8c4acd0350 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:08.250001 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-9307f857-1746-4658-ab55-b7f721a33953 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:08.250792 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-9307f857-1746-4658-ab55-b7f721a33953 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:08.256832 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9307f857-1746-4658-ab55-b7f721a33953 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:08.257315 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9307f857-1746-4658-ab55-b7f721a33953 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:08.257753 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9307f857-1746-4658-ab55-b7f721a33953 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:08.258442 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9307f857-1746-4658-ab55-b7f721a33953 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:08.258898 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9307f857-1746-4658-ab55-b7f721a33953 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:08.259324 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9307f857-1746-4658-ab55-b7f721a33953 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:08.389141 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-9307f857-1746-4658-ab55-b7f721a33953 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:08.395296 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-9307f857-1746-4658-ab55-b7f721a33953 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1523 microversion: 2.1 time: 0.149183 Sep 30 19:31:08.395859 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 184/346] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:08 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:31:08.478584 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-2203dd69-0ee6-4330-bd30-eddcfe3e130b tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:08.479187 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-2203dd69-0ee6-4330-bd30-eddcfe3e130b tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 0d0d6662-98d6-49c6-9149-0f8c4acd0350] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:08.485923 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2203dd69-0ee6-4330-bd30-eddcfe3e130b tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:08.486410 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2203dd69-0ee6-4330-bd30-eddcfe3e130b tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:08.486921 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2203dd69-0ee6-4330-bd30-eddcfe3e130b tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:08.487673 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2203dd69-0ee6-4330-bd30-eddcfe3e130b tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:08.488133 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2203dd69-0ee6-4330-bd30-eddcfe3e130b tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:08.488597 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2203dd69-0ee6-4330-bd30-eddcfe3e130b tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:08.618929 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-2203dd69-0ee6-4330-bd30-eddcfe3e130b tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139dfba82fda43f1a058c60b1a4dc818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e6fee821e7449b92c3df24de169fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:08.626513 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-2203dd69-0ee6-4330-bd30-eddcfe3e130b tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] 10.222.0.17 "GET /compute/v2.1/servers/0d0d6662-98d6-49c6-9149-0f8c4acd0350" status: 200 len: 1313 microversion: 2.1 time: 0.151730 Sep 30 19:31:08.627072 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 163/347] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:08 2022] GET /compute/v2.1/servers/0d0d6662-98d6-49c6-9149-0f8c4acd0350 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:09.419072 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-a8c6e027-462a-434f-b673-52e80bbe3445 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:09.419710 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-a8c6e027-462a-434f-b673-52e80bbe3445 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:09.425689 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a8c6e027-462a-434f-b673-52e80bbe3445 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:09.426169 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a8c6e027-462a-434f-b673-52e80bbe3445 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:09.426604 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a8c6e027-462a-434f-b673-52e80bbe3445 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:09.427291 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a8c6e027-462a-434f-b673-52e80bbe3445 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:09.427744 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a8c6e027-462a-434f-b673-52e80bbe3445 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:09.428170 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a8c6e027-462a-434f-b673-52e80bbe3445 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:09.556638 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-a8c6e027-462a-434f-b673-52e80bbe3445 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:09.564789 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-a8c6e027-462a-434f-b673-52e80bbe3445 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1523 microversion: 2.1 time: 0.149569 Sep 30 19:31:09.565353 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 185/348] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:09 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:09.649075 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-9fc1a913-4bd7-4138-a3c8-3d281e8593d9 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:09.649681 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-9fc1a913-4bd7-4138-a3c8-3d281e8593d9 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 0d0d6662-98d6-49c6-9149-0f8c4acd0350] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:09.655963 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9fc1a913-4bd7-4138-a3c8-3d281e8593d9 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:09.656473 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9fc1a913-4bd7-4138-a3c8-3d281e8593d9 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:09.656913 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9fc1a913-4bd7-4138-a3c8-3d281e8593d9 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:09.657611 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9fc1a913-4bd7-4138-a3c8-3d281e8593d9 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:09.658061 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9fc1a913-4bd7-4138-a3c8-3d281e8593d9 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:09.658484 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9fc1a913-4bd7-4138-a3c8-3d281e8593d9 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:09.786931 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-9fc1a913-4bd7-4138-a3c8-3d281e8593d9 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139dfba82fda43f1a058c60b1a4dc818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e6fee821e7449b92c3df24de169fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:09.794594 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-9fc1a913-4bd7-4138-a3c8-3d281e8593d9 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] 10.222.0.17 "GET /compute/v2.1/servers/0d0d6662-98d6-49c6-9149-0f8c4acd0350" status: 200 len: 1313 microversion: 2.1 time: 0.149429 Sep 30 19:31:09.795490 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 164/349] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:09 2022] GET /compute/v2.1/servers/0d0d6662-98d6-49c6-9149-0f8c4acd0350 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:10.588072 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-12fcf8bb-bee7-485e-b415-7f411213166c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:10.588736 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-12fcf8bb-bee7-485e-b415-7f411213166c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:10.594703 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-12fcf8bb-bee7-485e-b415-7f411213166c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:10.595210 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-12fcf8bb-bee7-485e-b415-7f411213166c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:10.595649 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-12fcf8bb-bee7-485e-b415-7f411213166c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:10.596334 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-12fcf8bb-bee7-485e-b415-7f411213166c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:10.596924 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-12fcf8bb-bee7-485e-b415-7f411213166c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:10.597343 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-12fcf8bb-bee7-485e-b415-7f411213166c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:10.601289 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell1:SELECT=100 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:31:10.724503 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-12fcf8bb-bee7-485e-b415-7f411213166c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:10.732102 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-12fcf8bb-bee7-485e-b415-7f411213166c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1523 microversion: 2.1 time: 0.147820 Sep 30 19:31:10.732691 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 186/350] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:10 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:10.817485 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-84028519-021c-4944-87a4-0f493235e68e tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:10.818197 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-84028519-021c-4944-87a4-0f493235e68e tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 0d0d6662-98d6-49c6-9149-0f8c4acd0350] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:10.824587 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-84028519-021c-4944-87a4-0f493235e68e tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:10.825064 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-84028519-021c-4944-87a4-0f493235e68e tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:10.825495 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-84028519-021c-4944-87a4-0f493235e68e tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:10.826173 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-84028519-021c-4944-87a4-0f493235e68e tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:10.826670 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-84028519-021c-4944-87a4-0f493235e68e tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:10.827088 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-84028519-021c-4944-87a4-0f493235e68e tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:10.958787 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-84028519-021c-4944-87a4-0f493235e68e tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139dfba82fda43f1a058c60b1a4dc818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e6fee821e7449b92c3df24de169fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:10.966537 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-84028519-021c-4944-87a4-0f493235e68e tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] 10.222.0.17 "GET /compute/v2.1/servers/0d0d6662-98d6-49c6-9149-0f8c4acd0350" status: 200 len: 1313 microversion: 2.1 time: 0.152920 Sep 30 19:31:10.967091 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 165/351] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:10 2022] GET /compute/v2.1/servers/0d0d6662-98d6-49c6-9149-0f8c4acd0350 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:11.755569 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-ffacd87d-b4ac-4641-a32c-c91498b7d878 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:11.756233 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-ffacd87d-b4ac-4641-a32c-c91498b7d878 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:11.762054 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ffacd87d-b4ac-4641-a32c-c91498b7d878 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:11.762539 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ffacd87d-b4ac-4641-a32c-c91498b7d878 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:11.762969 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ffacd87d-b4ac-4641-a32c-c91498b7d878 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:11.763825 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ffacd87d-b4ac-4641-a32c-c91498b7d878 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:11.764280 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ffacd87d-b4ac-4641-a32c-c91498b7d878 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:11.764734 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ffacd87d-b4ac-4641-a32c-c91498b7d878 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:11.893581 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-ffacd87d-b4ac-4641-a32c-c91498b7d878 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:11.901106 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-ffacd87d-b4ac-4641-a32c-c91498b7d878 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1523 microversion: 2.1 time: 0.149911 Sep 30 19:31:11.901676 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 187/352] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:11 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:31:11.990832 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-82f88160-aa50-42f9-945d-a59ea5931932 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:11.991349 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-82f88160-aa50-42f9-945d-a59ea5931932 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 0d0d6662-98d6-49c6-9149-0f8c4acd0350] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:11.997631 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-82f88160-aa50-42f9-945d-a59ea5931932 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:11.998107 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-82f88160-aa50-42f9-945d-a59ea5931932 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:11.998538 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-82f88160-aa50-42f9-945d-a59ea5931932 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:11.999221 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-82f88160-aa50-42f9-945d-a59ea5931932 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:11.999673 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-82f88160-aa50-42f9-945d-a59ea5931932 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:12.000087 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-82f88160-aa50-42f9-945d-a59ea5931932 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:12.129673 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-82f88160-aa50-42f9-945d-a59ea5931932 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139dfba82fda43f1a058c60b1a4dc818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e6fee821e7449b92c3df24de169fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:12.138311 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-82f88160-aa50-42f9-945d-a59ea5931932 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] 10.222.0.17 "GET /compute/v2.1/servers/0d0d6662-98d6-49c6-9149-0f8c4acd0350" status: 200 len: 1313 microversion: 2.1 time: 0.152257 Sep 30 19:31:12.138873 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 166/353] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:11 2022] GET /compute/v2.1/servers/0d0d6662-98d6-49c6-9149-0f8c4acd0350 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:31:12.925185 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-abb48ac7-89ac-40c9-9160-87065a0d3b0e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:12.925821 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-abb48ac7-89ac-40c9-9160-87065a0d3b0e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:12.931736 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-abb48ac7-89ac-40c9-9160-87065a0d3b0e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:12.932225 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-abb48ac7-89ac-40c9-9160-87065a0d3b0e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:12.932705 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-abb48ac7-89ac-40c9-9160-87065a0d3b0e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:12.933409 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-abb48ac7-89ac-40c9-9160-87065a0d3b0e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:12.933866 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-abb48ac7-89ac-40c9-9160-87065a0d3b0e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:12.934319 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-abb48ac7-89ac-40c9-9160-87065a0d3b0e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:13.077359 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-abb48ac7-89ac-40c9-9160-87065a0d3b0e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:13.085939 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-abb48ac7-89ac-40c9-9160-87065a0d3b0e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1523 microversion: 2.1 time: 0.165236 Sep 30 19:31:13.086509 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 188/354] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:12 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:13.163920 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-2963c5db-8844-42d9-ac0a-0b38c24b854e tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:13.164634 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-2963c5db-8844-42d9-ac0a-0b38c24b854e tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 0d0d6662-98d6-49c6-9149-0f8c4acd0350] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:13.171467 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2963c5db-8844-42d9-ac0a-0b38c24b854e tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:13.172219 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2963c5db-8844-42d9-ac0a-0b38c24b854e tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:13.172715 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2963c5db-8844-42d9-ac0a-0b38c24b854e tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:13.173638 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2963c5db-8844-42d9-ac0a-0b38c24b854e tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:13.174093 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2963c5db-8844-42d9-ac0a-0b38c24b854e tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:13.174535 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2963c5db-8844-42d9-ac0a-0b38c24b854e tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:13.327807 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-2963c5db-8844-42d9-ac0a-0b38c24b854e tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139dfba82fda43f1a058c60b1a4dc818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e6fee821e7449b92c3df24de169fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:13.339019 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-2963c5db-8844-42d9-ac0a-0b38c24b854e tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] 10.222.0.17 "GET /compute/v2.1/servers/0d0d6662-98d6-49c6-9149-0f8c4acd0350" status: 200 len: 1313 microversion: 2.1 time: 0.179485 Sep 30 19:31:13.339783 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 167/355] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:13 2022] GET /compute/v2.1/servers/0d0d6662-98d6-49c6-9149-0f8c4acd0350 => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:31:14.111224 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-2ab990b9-4ad8-4666-ad11-53b6128add03 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:14.111844 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-2ab990b9-4ad8-4666-ad11-53b6128add03 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:14.113716 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell0:SELECT=2 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:31:14.119743 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2ab990b9-4ad8-4666-ad11-53b6128add03 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:14.120316 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2ab990b9-4ad8-4666-ad11-53b6128add03 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:14.120859 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2ab990b9-4ad8-4666-ad11-53b6128add03 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:14.121672 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2ab990b9-4ad8-4666-ad11-53b6128add03 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:14.122205 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2ab990b9-4ad8-4666-ad11-53b6128add03 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:14.122705 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2ab990b9-4ad8-4666-ad11-53b6128add03 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:14.294375 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-2ab990b9-4ad8-4666-ad11-53b6128add03 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:14.302644 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-2ab990b9-4ad8-4666-ad11-53b6128add03 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1523 microversion: 2.1 time: 0.195855 Sep 30 19:31:14.303653 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 189/356] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:14 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1523 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:14.364611 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-0a855729-bc6b-4ffa-b36e-e03ee70d3321 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:14.365229 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-0a855729-bc6b-4ffa-b36e-e03ee70d3321 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 0d0d6662-98d6-49c6-9149-0f8c4acd0350] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:14.367176 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=2 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:31:14.367938 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=6 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:31:14.374280 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0a855729-bc6b-4ffa-b36e-e03ee70d3321 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:14.374766 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0a855729-bc6b-4ffa-b36e-e03ee70d3321 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:14.375203 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0a855729-bc6b-4ffa-b36e-e03ee70d3321 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:14.375907 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0a855729-bc6b-4ffa-b36e-e03ee70d3321 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:14.376902 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0a855729-bc6b-4ffa-b36e-e03ee70d3321 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:14.377330 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0a855729-bc6b-4ffa-b36e-e03ee70d3321 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:14.513863 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-0a855729-bc6b-4ffa-b36e-e03ee70d3321 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139dfba82fda43f1a058c60b1a4dc818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e6fee821e7449b92c3df24de169fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:14.517459 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=100 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:31:14.522819 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-0a855729-bc6b-4ffa-b36e-e03ee70d3321 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] 10.222.0.17 "GET /compute/v2.1/servers/0d0d6662-98d6-49c6-9149-0f8c4acd0350" status: 200 len: 1313 microversion: 2.1 time: 0.162179 Sep 30 19:31:14.523395 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 168/357] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:14 2022] GET /compute/v2.1/servers/0d0d6662-98d6-49c6-9149-0f8c4acd0350 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:15.326091 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-c38e4803-dbd6-4daf-b6f5-e5a1f9cd09d5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:15.326692 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-c38e4803-dbd6-4daf-b6f5-e5a1f9cd09d5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:15.333132 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c38e4803-dbd6-4daf-b6f5-e5a1f9cd09d5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:15.333612 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c38e4803-dbd6-4daf-b6f5-e5a1f9cd09d5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:15.334042 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c38e4803-dbd6-4daf-b6f5-e5a1f9cd09d5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:15.334732 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c38e4803-dbd6-4daf-b6f5-e5a1f9cd09d5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:15.335181 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c38e4803-dbd6-4daf-b6f5-e5a1f9cd09d5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:15.335600 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c38e4803-dbd6-4daf-b6f5-e5a1f9cd09d5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:15.475336 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-c38e4803-dbd6-4daf-b6f5-e5a1f9cd09d5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:15.483159 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-c38e4803-dbd6-4daf-b6f5-e5a1f9cd09d5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1523 microversion: 2.1 time: 0.160741 Sep 30 19:31:15.483766 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 190/358] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:15 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:31:15.550480 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-5360f70d-fdd8-42ff-965e-3e799dca7745 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:15.551302 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-5360f70d-fdd8-42ff-965e-3e799dca7745 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 0d0d6662-98d6-49c6-9149-0f8c4acd0350] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:15.560790 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5360f70d-fdd8-42ff-965e-3e799dca7745 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:15.561583 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5360f70d-fdd8-42ff-965e-3e799dca7745 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:15.562190 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5360f70d-fdd8-42ff-965e-3e799dca7745 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:15.563143 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5360f70d-fdd8-42ff-965e-3e799dca7745 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:15.564313 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5360f70d-fdd8-42ff-965e-3e799dca7745 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:15.565071 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5360f70d-fdd8-42ff-965e-3e799dca7745 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:15.727438 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-5360f70d-fdd8-42ff-965e-3e799dca7745 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139dfba82fda43f1a058c60b1a4dc818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e6fee821e7449b92c3df24de169fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:15.737735 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [req-21e2edaa-99bc-44a3-be3a-06963e03c4b8 req-e674390b-6de9-420a-a0d4-3e73c7f594de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d0d6662-98d6-49c6-9149-0f8c4acd0350", "name": "network-vif-plugged", "status": "completed", "tag": "8ddd7bb7-11e2-44a4-9c7c-df0c58a2ab6d"}]} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:31:15.737935 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-5360f70d-fdd8-42ff-965e-3e799dca7745 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] 10.222.0.17 "GET /compute/v2.1/servers/0d0d6662-98d6-49c6-9149-0f8c4acd0350" status: 200 len: 1313 microversion: 2.1 time: 0.193782 Sep 30 19:31:15.738936 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 169/359] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:15 2022] GET /compute/v2.1/servers/0d0d6662-98d6-49c6-9149-0f8c4acd0350 => generated 1313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:15.753697 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-21e2edaa-99bc-44a3-be3a-06963e03c4b8 req-e674390b-6de9-420a-a0d4-3e73c7f594de service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:15.754267 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-21e2edaa-99bc-44a3-be3a-06963e03c4b8 req-e674390b-6de9-420a-a0d4-3e73c7f594de service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:15.754722 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-21e2edaa-99bc-44a3-be3a-06963e03c4b8 req-e674390b-6de9-420a-a0d4-3e73c7f594de service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:15.767305 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.compute.server_external_events [req-21e2edaa-99bc-44a3-be3a-06963e03c4b8 req-e674390b-6de9-420a-a0d4-3e73c7f594de service nova] Creating event network-vif-plugged:8ddd7bb7-11e2-44a4-9c7c-df0c58a2ab6d for instance 0d0d6662-98d6-49c6-9149-0f8c4acd0350 on hv-cinder-86001 Sep 30 19:31:15.776810 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [req-21e2edaa-99bc-44a3-be3a-06963e03c4b8 req-e674390b-6de9-420a-a0d4-3e73c7f594de service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043600 Sep 30 19:31:15.777764 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 191/360] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:31:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 30 19:31:15.858177 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-402d85c2-8697-48a5-b9cf-9c81b91486cc tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1276279124", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1090227529", "security_groups": [{"name": "tempest-secgroup-smoke-1750309272"}], "networks": [{"uuid": "784f92f1-2e84-4f16-be0d-18f26011b7ba"}], "block_device_mapping_v2": [{"uuid": "7e13491a-5b0f-4fac-aa63-450d176a4e3b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:31:15.980703 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.network.neutron [None req-402d85c2-8697-48a5-b9cf-9c81b91486cc tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] validate_networks() for [('784f92f1-2e84-4f16-be0d-18f26011b7ba', None, None, None, None, None)] {{(pid=120648) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 30 19:31:16.402207 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-402d85c2-8697-48a5-b9cf-9c81b91486cc tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Flavor limits 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 30 19:31:16.402207 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-402d85c2-8697-48a5-b9cf-9c81b91486cc tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Image limits 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 30 19:31:16.402207 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-402d85c2-8697-48a5-b9cf-9c81b91486cc tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Flavor pref 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 30 19:31:16.402207 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-402d85c2-8697-48a5-b9cf-9c81b91486cc tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Image pref 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 30 19:31:16.402562 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-402d85c2-8697-48a5-b9cf-9c81b91486cc tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 30 19:31:16.412405 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-402d85c2-8697-48a5-b9cf-9c81b91486cc tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:16.412887 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-402d85c2-8697-48a5-b9cf-9c81b91486cc tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:16.413311 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-402d85c2-8697-48a5-b9cf-9c81b91486cc tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:16.414228 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-402d85c2-8697-48a5-b9cf-9c81b91486cc tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:16.414876 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-402d85c2-8697-48a5-b9cf-9c81b91486cc tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:16.415295 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-402d85c2-8697-48a5-b9cf-9c81b91486cc tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:16.432210 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-402d85c2-8697-48a5-b9cf-9c81b91486cc tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Getting quotas for project 4e940e1f7e3140f2865594bcdfc427a0. Resources: {'instances', 'ram', 'cores'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 30 19:31:16.436684 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-402d85c2-8697-48a5-b9cf-9c81b91486cc tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Getting quotas for user 0e76ffd048d240ab94ee7e30b261d3cc and project 4e940e1f7e3140f2865594bcdfc427a0. Resources: {'instances', 'ram', 'cores'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 30 19:31:16.497153 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-402d85c2-8697-48a5-b9cf-9c81b91486cc tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Going to run 1 instances... {{(pid=120648) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 30 19:31:16.499260 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-402d85c2-8697-48a5-b9cf-9c81b91486cc tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7e13491a-5b0f-4fac-aa63-450d176a4e3b',volume_size=None,volume_type=None)] {{(pid=120648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 30 19:31:16.509565 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-37e307e7-ad1a-477a-b9fc-7f6886e7a0d9 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:16.510349 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-37e307e7-ad1a-477a-b9fc-7f6886e7a0d9 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:16.517204 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-37e307e7-ad1a-477a-b9fc-7f6886e7a0d9 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:16.517703 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-37e307e7-ad1a-477a-b9fc-7f6886e7a0d9 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:16.518150 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-37e307e7-ad1a-477a-b9fc-7f6886e7a0d9 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:16.518855 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-37e307e7-ad1a-477a-b9fc-7f6886e7a0d9 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:16.519315 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-37e307e7-ad1a-477a-b9fc-7f6886e7a0d9 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:16.519746 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-37e307e7-ad1a-477a-b9fc-7f6886e7a0d9 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:16.670843 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-37e307e7-ad1a-477a-b9fc-7f6886e7a0d9 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:16.680752 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-37e307e7-ad1a-477a-b9fc-7f6886e7a0d9 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1523 microversion: 2.1 time: 0.177078 Sep 30 19:31:16.693204 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 192/361] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:16 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:31:16.693517 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-402d85c2-8697-48a5-b9cf-9c81b91486cc tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.828342 Sep 30 19:31:16.693517 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 170/362] 10.222.0.17 () {60 vars in 1147 bytes} [Fri Sep 30 19:31:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 30 19:31:16.695178 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-e9e31553-d355-4170-bffa-191144c0d024 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:16.696108 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-e9e31553-d355-4170-bffa-191144c0d024 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:16.753093 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-e9e31553-d355-4170-bffa-191144c0d024 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:16.763472 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-e9e31553-d355-4170-bffa-191144c0d024 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1089 microversion: 2.1 time: 0.070495 Sep 30 19:31:16.764186 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 193/363] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:16 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1089 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:16.765756 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-a57283e5-53b1-4ec3-802d-95194a971f2e tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:16.767150 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-a57283e5-53b1-4ec3-802d-95194a971f2e tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 0d0d6662-98d6-49c6-9149-0f8c4acd0350] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:16.775529 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a57283e5-53b1-4ec3-802d-95194a971f2e tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:16.776279 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a57283e5-53b1-4ec3-802d-95194a971f2e tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:16.776833 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a57283e5-53b1-4ec3-802d-95194a971f2e tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:16.777619 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a57283e5-53b1-4ec3-802d-95194a971f2e tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:16.778151 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a57283e5-53b1-4ec3-802d-95194a971f2e tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:16.778651 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a57283e5-53b1-4ec3-802d-95194a971f2e tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:16.924781 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-a57283e5-53b1-4ec3-802d-95194a971f2e tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139dfba82fda43f1a058c60b1a4dc818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e6fee821e7449b92c3df24de169fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:16.932852 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-a57283e5-53b1-4ec3-802d-95194a971f2e tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] 10.222.0.17 "GET /compute/v2.1/servers/0d0d6662-98d6-49c6-9149-0f8c4acd0350" status: 200 len: 1313 microversion: 2.1 time: 0.171592 Sep 30 19:31:16.933624 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 171/364] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:16 2022] GET /compute/v2.1/servers/0d0d6662-98d6-49c6-9149-0f8c4acd0350 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:31:17.705066 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-33411633-87b0-41a3-a4ad-6012afc1342c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:17.705682 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-33411633-87b0-41a3-a4ad-6012afc1342c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:17.707696 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_api:SELECT=58 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:31:17.713055 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-33411633-87b0-41a3-a4ad-6012afc1342c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:17.713547 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-33411633-87b0-41a3-a4ad-6012afc1342c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:17.713985 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-33411633-87b0-41a3-a4ad-6012afc1342c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:17.714691 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-33411633-87b0-41a3-a4ad-6012afc1342c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:17.715148 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-33411633-87b0-41a3-a4ad-6012afc1342c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:17.715576 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-33411633-87b0-41a3-a4ad-6012afc1342c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:17.788208 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-30d5cdbf-d2ba-4697-ac14-2d9d4abc5494 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:17.788946 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-30d5cdbf-d2ba-4697-ac14-2d9d4abc5494 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:17.792597 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=6 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:31:17.798915 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-30d5cdbf-d2ba-4697-ac14-2d9d4abc5494 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:17.799546 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-30d5cdbf-d2ba-4697-ac14-2d9d4abc5494 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:17.799937 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-30d5cdbf-d2ba-4697-ac14-2d9d4abc5494 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:17.800681 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-30d5cdbf-d2ba-4697-ac14-2d9d4abc5494 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:17.801145 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-30d5cdbf-d2ba-4697-ac14-2d9d4abc5494 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:17.801575 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-30d5cdbf-d2ba-4697-ac14-2d9d4abc5494 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:17.869397 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-33411633-87b0-41a3-a4ad-6012afc1342c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:17.878206 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-33411633-87b0-41a3-a4ad-6012afc1342c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1523 microversion: 2.1 time: 0.176504 Sep 30 19:31:17.880148 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-30d5cdbf-d2ba-4697-ac14-2d9d4abc5494 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:17.888217 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-30d5cdbf-d2ba-4697-ac14-2d9d4abc5494 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1187 microversion: 2.1 time: 0.104373 Sep 30 19:31:17.888885 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 172/365] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:17 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1187 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:31:17.893347 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 194/366] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:17 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1523 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:17.955559 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-8f76a0aa-0a8d-470e-bb92-3f6eea0736e6 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:17.956166 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-8f76a0aa-0a8d-470e-bb92-3f6eea0736e6 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 0d0d6662-98d6-49c6-9149-0f8c4acd0350] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:17.961921 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8f76a0aa-0a8d-470e-bb92-3f6eea0736e6 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:17.962693 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8f76a0aa-0a8d-470e-bb92-3f6eea0736e6 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:17.962808 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8f76a0aa-0a8d-470e-bb92-3f6eea0736e6 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:17.963686 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8f76a0aa-0a8d-470e-bb92-3f6eea0736e6 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:17.964501 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8f76a0aa-0a8d-470e-bb92-3f6eea0736e6 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:17.965077 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8f76a0aa-0a8d-470e-bb92-3f6eea0736e6 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:18.478234 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-8f76a0aa-0a8d-470e-bb92-3f6eea0736e6 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139dfba82fda43f1a058c60b1a4dc818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e6fee821e7449b92c3df24de169fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:18.487170 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-8f76a0aa-0a8d-470e-bb92-3f6eea0736e6 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] 10.222.0.17 "GET /compute/v2.1/servers/0d0d6662-98d6-49c6-9149-0f8c4acd0350" status: 200 len: 1313 microversion: 2.1 time: 0.535559 Sep 30 19:31:18.487862 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 173/367] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:17 2022] GET /compute/v2.1/servers/0d0d6662-98d6-49c6-9149-0f8c4acd0350 => generated 1313 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:18.899870 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-086e8b6d-bdd3-4d39-ab79-96c0dd2caefa tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:18.900503 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-086e8b6d-bdd3-4d39-ab79-96c0dd2caefa tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:18.906695 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-086e8b6d-bdd3-4d39-ab79-96c0dd2caefa tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:18.907720 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-086e8b6d-bdd3-4d39-ab79-96c0dd2caefa tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:18.908165 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-086e8b6d-bdd3-4d39-ab79-96c0dd2caefa tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:18.908885 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-086e8b6d-bdd3-4d39-ab79-96c0dd2caefa tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:18.909596 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-086e8b6d-bdd3-4d39-ab79-96c0dd2caefa tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:18.910023 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-086e8b6d-bdd3-4d39-ab79-96c0dd2caefa tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:18.912816 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-0e94719f-ff0f-427e-acaf-e40bf19a13e2 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:18.913955 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-0e94719f-ff0f-427e-acaf-e40bf19a13e2 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:18.920983 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0e94719f-ff0f-427e-acaf-e40bf19a13e2 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:18.921922 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0e94719f-ff0f-427e-acaf-e40bf19a13e2 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:18.922424 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0e94719f-ff0f-427e-acaf-e40bf19a13e2 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:18.923955 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0e94719f-ff0f-427e-acaf-e40bf19a13e2 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:18.924500 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0e94719f-ff0f-427e-acaf-e40bf19a13e2 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:18.925195 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0e94719f-ff0f-427e-acaf-e40bf19a13e2 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:19.006943 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-0e94719f-ff0f-427e-acaf-e40bf19a13e2 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:19.019725 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-0e94719f-ff0f-427e-acaf-e40bf19a13e2 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1187 microversion: 2.1 time: 0.112276 Sep 30 19:31:19.020400 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 174/368] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:18 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1187 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:31:19.050495 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-086e8b6d-bdd3-4d39-ab79-96c0dd2caefa tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:19.058349 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-086e8b6d-bdd3-4d39-ab79-96c0dd2caefa tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1523 microversion: 2.1 time: 0.162233 Sep 30 19:31:19.058911 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 195/369] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:18 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:19.509590 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e42b5c11-5131-427e-b4b1-b68643400551 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:19.510290 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-e42b5c11-5131-427e-b4b1-b68643400551 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 0d0d6662-98d6-49c6-9149-0f8c4acd0350] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:19.516449 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e42b5c11-5131-427e-b4b1-b68643400551 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:19.517054 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e42b5c11-5131-427e-b4b1-b68643400551 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:19.517557 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e42b5c11-5131-427e-b4b1-b68643400551 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:19.518315 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e42b5c11-5131-427e-b4b1-b68643400551 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:19.519038 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e42b5c11-5131-427e-b4b1-b68643400551 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:19.519349 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e42b5c11-5131-427e-b4b1-b68643400551 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:19.664087 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-e42b5c11-5131-427e-b4b1-b68643400551 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139dfba82fda43f1a058c60b1a4dc818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e6fee821e7449b92c3df24de169fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:19.672203 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-e42b5c11-5131-427e-b4b1-b68643400551 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] 10.222.0.17 "GET /compute/v2.1/servers/0d0d6662-98d6-49c6-9149-0f8c4acd0350" status: 200 len: 1496 microversion: 2.1 time: 0.166852 Sep 30 19:31:19.684389 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 175/370] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:19 2022] GET /compute/v2.1/servers/0d0d6662-98d6-49c6-9149-0f8c4acd0350 => generated 1496 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:20.044539 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-22e2a1ba-77c1-44a1-abe3-63c36302c096 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:20.045349 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-22e2a1ba-77c1-44a1-abe3-63c36302c096 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:20.052774 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-22e2a1ba-77c1-44a1-abe3-63c36302c096 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:20.053277 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-22e2a1ba-77c1-44a1-abe3-63c36302c096 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:20.053709 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-22e2a1ba-77c1-44a1-abe3-63c36302c096 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:20.054403 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-22e2a1ba-77c1-44a1-abe3-63c36302c096 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:20.055020 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-22e2a1ba-77c1-44a1-abe3-63c36302c096 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:20.055262 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-22e2a1ba-77c1-44a1-abe3-63c36302c096 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:20.081219 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-679c1f08-2e05-409f-b82c-0df9f77da53c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:20.086095 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-679c1f08-2e05-409f-b82c-0df9f77da53c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:20.088979 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-679c1f08-2e05-409f-b82c-0df9f77da53c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:20.089479 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-679c1f08-2e05-409f-b82c-0df9f77da53c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:20.089915 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-679c1f08-2e05-409f-b82c-0df9f77da53c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:20.090613 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-679c1f08-2e05-409f-b82c-0df9f77da53c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:20.091074 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-679c1f08-2e05-409f-b82c-0df9f77da53c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:20.091684 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-679c1f08-2e05-409f-b82c-0df9f77da53c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:20.240427 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-679c1f08-2e05-409f-b82c-0df9f77da53c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:20.245516 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-679c1f08-2e05-409f-b82c-0df9f77da53c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1523 microversion: 2.1 time: 0.168213 Sep 30 19:31:20.246082 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 176/371] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:20 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:31:20.365338 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-22e2a1ba-77c1-44a1-abe3-63c36302c096 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:20.372825 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-22e2a1ba-77c1-44a1-abe3-63c36302c096 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1187 microversion: 2.1 time: 0.332021 Sep 30 19:31:20.373380 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 196/372] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:20 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1187 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:21.268123 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-21375c52-e28f-4eba-a12d-c74af033c0c6 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:21.268927 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-21375c52-e28f-4eba-a12d-c74af033c0c6 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:21.275541 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-21375c52-e28f-4eba-a12d-c74af033c0c6 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:21.276023 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-21375c52-e28f-4eba-a12d-c74af033c0c6 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:21.276493 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-21375c52-e28f-4eba-a12d-c74af033c0c6 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:21.277187 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-21375c52-e28f-4eba-a12d-c74af033c0c6 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:21.278085 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-21375c52-e28f-4eba-a12d-c74af033c0c6 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:21.278617 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-21375c52-e28f-4eba-a12d-c74af033c0c6 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:21.395991 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-57c4ffc9-9e78-4d14-bf03-117cd9afe5f3 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:21.397972 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-57c4ffc9-9e78-4d14-bf03-117cd9afe5f3 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:21.411742 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-57c4ffc9-9e78-4d14-bf03-117cd9afe5f3 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:21.412658 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-57c4ffc9-9e78-4d14-bf03-117cd9afe5f3 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:21.413107 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-57c4ffc9-9e78-4d14-bf03-117cd9afe5f3 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:21.413821 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-57c4ffc9-9e78-4d14-bf03-117cd9afe5f3 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:21.414281 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-57c4ffc9-9e78-4d14-bf03-117cd9afe5f3 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:21.414707 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-57c4ffc9-9e78-4d14-bf03-117cd9afe5f3 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:21.427416 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-21375c52-e28f-4eba-a12d-c74af033c0c6 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:21.435778 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-21375c52-e28f-4eba-a12d-c74af033c0c6 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1523 microversion: 2.1 time: 0.171979 Sep 30 19:31:21.436789 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 177/373] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:21 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:21.492120 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-57c4ffc9-9e78-4d14-bf03-117cd9afe5f3 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:21.500262 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-57c4ffc9-9e78-4d14-bf03-117cd9afe5f3 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1187 microversion: 2.1 time: 0.108746 Sep 30 19:31:21.501195 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 197/374] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:21 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1187 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:22.459343 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-253d2291-89af-43de-8354-cf4c8cec639e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:22.459990 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-253d2291-89af-43de-8354-cf4c8cec639e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:22.466323 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-253d2291-89af-43de-8354-cf4c8cec639e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:22.466815 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-253d2291-89af-43de-8354-cf4c8cec639e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:22.467256 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-253d2291-89af-43de-8354-cf4c8cec639e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:22.467955 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-253d2291-89af-43de-8354-cf4c8cec639e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:22.468435 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-253d2291-89af-43de-8354-cf4c8cec639e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:22.468878 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-253d2291-89af-43de-8354-cf4c8cec639e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:22.523432 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-3c1768c6-e836-456c-bd59-dc06870c526a tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:22.524130 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-3c1768c6-e836-456c-bd59-dc06870c526a tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:22.530838 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3c1768c6-e836-456c-bd59-dc06870c526a tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:22.531408 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3c1768c6-e836-456c-bd59-dc06870c526a tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:22.532496 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3c1768c6-e836-456c-bd59-dc06870c526a tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:22.533261 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3c1768c6-e836-456c-bd59-dc06870c526a tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:22.533784 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3c1768c6-e836-456c-bd59-dc06870c526a tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:22.534687 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3c1768c6-e836-456c-bd59-dc06870c526a tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:22.618740 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-253d2291-89af-43de-8354-cf4c8cec639e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:22.628438 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-253d2291-89af-43de-8354-cf4c8cec639e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1523 microversion: 2.1 time: 0.172639 Sep 30 19:31:22.641974 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 178/375] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:22 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:22.743577 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-3c1768c6-e836-456c-bd59-dc06870c526a tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:22.751319 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-3c1768c6-e836-456c-bd59-dc06870c526a tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1187 microversion: 2.1 time: 0.232067 Sep 30 19:31:22.752393 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 198/376] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:22 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1187 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:31:23.662271 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-1258de1f-8d41-4e9b-9fb3-25588051d3ce tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:23.662857 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-1258de1f-8d41-4e9b-9fb3-25588051d3ce tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:23.669733 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1258de1f-8d41-4e9b-9fb3-25588051d3ce tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:23.670230 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1258de1f-8d41-4e9b-9fb3-25588051d3ce tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:23.670671 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1258de1f-8d41-4e9b-9fb3-25588051d3ce tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:23.671432 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1258de1f-8d41-4e9b-9fb3-25588051d3ce tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:23.671833 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1258de1f-8d41-4e9b-9fb3-25588051d3ce tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:23.672260 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1258de1f-8d41-4e9b-9fb3-25588051d3ce tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:23.774957 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-817cbb3a-695d-4848-84a0-753bf56747bc tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:23.776118 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-817cbb3a-695d-4848-84a0-753bf56747bc tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:23.782540 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-817cbb3a-695d-4848-84a0-753bf56747bc tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:23.783025 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-817cbb3a-695d-4848-84a0-753bf56747bc tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:23.783648 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-817cbb3a-695d-4848-84a0-753bf56747bc tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:23.784831 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-817cbb3a-695d-4848-84a0-753bf56747bc tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:23.785267 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-817cbb3a-695d-4848-84a0-753bf56747bc tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:23.785863 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-817cbb3a-695d-4848-84a0-753bf56747bc tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:23.866650 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-1258de1f-8d41-4e9b-9fb3-25588051d3ce tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:23.874759 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-1258de1f-8d41-4e9b-9fb3-25588051d3ce tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1523 microversion: 2.1 time: 0.216561 Sep 30 19:31:23.875442 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 179/377] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:23 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1523 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:23.880159 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-817cbb3a-695d-4848-84a0-753bf56747bc tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:23.891208 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-817cbb3a-695d-4848-84a0-753bf56747bc tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1187 microversion: 2.1 time: 0.120465 Sep 30 19:31:23.892164 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 199/378] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:23 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1187 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:31:23.936190 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-2485d47c-08c4-46ed-9e9e-7918bc5de9a3 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:23.936714 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-2485d47c-08c4-46ed-9e9e-7918bc5de9a3 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 0d0d6662-98d6-49c6-9149-0f8c4acd0350] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:23.942642 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2485d47c-08c4-46ed-9e9e-7918bc5de9a3 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:23.943127 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2485d47c-08c4-46ed-9e9e-7918bc5de9a3 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:23.943564 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2485d47c-08c4-46ed-9e9e-7918bc5de9a3 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:23.944252 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2485d47c-08c4-46ed-9e9e-7918bc5de9a3 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:23.944744 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2485d47c-08c4-46ed-9e9e-7918bc5de9a3 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:23.945168 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2485d47c-08c4-46ed-9e9e-7918bc5de9a3 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:23.969368 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-2485d47c-08c4-46ed-9e9e-7918bc5de9a3 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 0d0d6662-98d6-49c6-9149-0f8c4acd0350] Going to try to terminate instance {{(pid=120648) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 30 19:31:24.058964 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-2485d47c-08c4-46ed-9e9e-7918bc5de9a3 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0d0d6662-98d6-49c6-9149-0f8c4acd0350" status: 204 len: 0 microversion: 2.1 time: 0.126283 Sep 30 19:31:24.059548 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 180/379] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 30 19:31:23 2022] DELETE /compute/v2.1/servers/0d0d6662-98d6-49c6-9149-0f8c4acd0350 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 30 19:31:24.068265 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-c1bb6939-e01e-4434-9736-d77412b8c2b8 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:24.068919 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-c1bb6939-e01e-4434-9736-d77412b8c2b8 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 0d0d6662-98d6-49c6-9149-0f8c4acd0350] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:24.074811 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c1bb6939-e01e-4434-9736-d77412b8c2b8 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:24.075292 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c1bb6939-e01e-4434-9736-d77412b8c2b8 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:24.075730 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c1bb6939-e01e-4434-9736-d77412b8c2b8 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:24.076442 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c1bb6939-e01e-4434-9736-d77412b8c2b8 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:24.076897 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c1bb6939-e01e-4434-9736-d77412b8c2b8 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:24.077323 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c1bb6939-e01e-4434-9736-d77412b8c2b8 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:24.269434 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-c1bb6939-e01e-4434-9736-d77412b8c2b8 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139dfba82fda43f1a058c60b1a4dc818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e6fee821e7449b92c3df24de169fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:24.277726 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-c1bb6939-e01e-4434-9736-d77412b8c2b8 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] 10.222.0.17 "GET /compute/v2.1/servers/0d0d6662-98d6-49c6-9149-0f8c4acd0350" status: 200 len: 1502 microversion: 2.1 time: 0.213569 Sep 30 19:31:24.278287 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 200/380] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:24 2022] GET /compute/v2.1/servers/0d0d6662-98d6-49c6-9149-0f8c4acd0350 => generated 1502 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:24.900063 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-2f4c8369-a8dc-444e-a782-107c2b0f0d9a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:24.900905 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-2f4c8369-a8dc-444e-a782-107c2b0f0d9a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:24.907138 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2f4c8369-a8dc-444e-a782-107c2b0f0d9a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:24.907688 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2f4c8369-a8dc-444e-a782-107c2b0f0d9a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:24.908190 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2f4c8369-a8dc-444e-a782-107c2b0f0d9a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:24.910706 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2f4c8369-a8dc-444e-a782-107c2b0f0d9a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:24.911230 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2f4c8369-a8dc-444e-a782-107c2b0f0d9a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:24.911738 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2f4c8369-a8dc-444e-a782-107c2b0f0d9a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:24.916426 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-65539ec7-9acd-4618-b781-68f73c4b5836 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:24.918151 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-65539ec7-9acd-4618-b781-68f73c4b5836 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:24.926568 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-65539ec7-9acd-4618-b781-68f73c4b5836 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:24.927033 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-65539ec7-9acd-4618-b781-68f73c4b5836 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:24.927889 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-65539ec7-9acd-4618-b781-68f73c4b5836 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:24.929012 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-65539ec7-9acd-4618-b781-68f73c4b5836 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:24.929403 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-65539ec7-9acd-4618-b781-68f73c4b5836 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:24.930002 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-65539ec7-9acd-4618-b781-68f73c4b5836 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:25.010618 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-65539ec7-9acd-4618-b781-68f73c4b5836 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:25.019382 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-65539ec7-9acd-4618-b781-68f73c4b5836 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1187 microversion: 2.1 time: 0.107930 Sep 30 19:31:25.020271 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 201/381] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:24 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1187 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:31:25.081104 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-2f4c8369-a8dc-444e-a782-107c2b0f0d9a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:25.088763 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-2f4c8369-a8dc-444e-a782-107c2b0f0d9a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1523 microversion: 2.1 time: 0.194425 Sep 30 19:31:25.089310 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 181/382] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:24 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1523 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:25.301432 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-aa6ab9e9-8a69-4522-8745-5a692989cfa3 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:25.302073 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-aa6ab9e9-8a69-4522-8745-5a692989cfa3 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 0d0d6662-98d6-49c6-9149-0f8c4acd0350] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:25.308074 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-aa6ab9e9-8a69-4522-8745-5a692989cfa3 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:25.308654 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-aa6ab9e9-8a69-4522-8745-5a692989cfa3 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:25.309114 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-aa6ab9e9-8a69-4522-8745-5a692989cfa3 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:25.309812 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-aa6ab9e9-8a69-4522-8745-5a692989cfa3 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:25.310270 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-aa6ab9e9-8a69-4522-8745-5a692989cfa3 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:25.310703 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-aa6ab9e9-8a69-4522-8745-5a692989cfa3 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:25.444973 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-aa6ab9e9-8a69-4522-8745-5a692989cfa3 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139dfba82fda43f1a058c60b1a4dc818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e6fee821e7449b92c3df24de169fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:25.452572 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-aa6ab9e9-8a69-4522-8745-5a692989cfa3 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] 10.222.0.17 "GET /compute/v2.1/servers/0d0d6662-98d6-49c6-9149-0f8c4acd0350" status: 200 len: 1502 microversion: 2.1 time: 0.155322 Sep 30 19:31:25.453563 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 202/383] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:25 2022] GET /compute/v2.1/servers/0d0d6662-98d6-49c6-9149-0f8c4acd0350 => generated 1502 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:26.044295 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-5f72b3c9-77cc-4dcc-b2ac-b412ab5945ab tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:26.044295 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-5f72b3c9-77cc-4dcc-b2ac-b412ab5945ab tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:26.050733 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5f72b3c9-77cc-4dcc-b2ac-b412ab5945ab tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:26.051227 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5f72b3c9-77cc-4dcc-b2ac-b412ab5945ab tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:26.051659 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5f72b3c9-77cc-4dcc-b2ac-b412ab5945ab tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:26.052350 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5f72b3c9-77cc-4dcc-b2ac-b412ab5945ab tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:26.052867 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5f72b3c9-77cc-4dcc-b2ac-b412ab5945ab tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:26.053367 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5f72b3c9-77cc-4dcc-b2ac-b412ab5945ab tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:26.111534 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-4651afb4-7323-45e1-9d0f-d0a4e280e690 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:26.112211 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-4651afb4-7323-45e1-9d0f-d0a4e280e690 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:26.118653 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-5f72b3c9-77cc-4dcc-b2ac-b412ab5945ab tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:26.119279 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4651afb4-7323-45e1-9d0f-d0a4e280e690 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:26.119837 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4651afb4-7323-45e1-9d0f-d0a4e280e690 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:26.120281 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4651afb4-7323-45e1-9d0f-d0a4e280e690 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:26.121190 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4651afb4-7323-45e1-9d0f-d0a4e280e690 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:26.121746 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4651afb4-7323-45e1-9d0f-d0a4e280e690 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:26.122747 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4651afb4-7323-45e1-9d0f-d0a4e280e690 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:26.127224 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-5f72b3c9-77cc-4dcc-b2ac-b412ab5945ab tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1187 microversion: 2.1 time: 0.088589 Sep 30 19:31:26.127784 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 182/384] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:26 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1187 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:26.271472 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-4651afb4-7323-45e1-9d0f-d0a4e280e690 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:26.279747 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-4651afb4-7323-45e1-9d0f-d0a4e280e690 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1523 microversion: 2.1 time: 0.172533 Sep 30 19:31:26.280593 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 203/385] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:26 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:26.475519 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-652a3cf9-1029-43ef-8b6a-845a1b5b0877 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:26.476382 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-652a3cf9-1029-43ef-8b6a-845a1b5b0877 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 0d0d6662-98d6-49c6-9149-0f8c4acd0350] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:26.478327 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=2 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:31:26.479081 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=6 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:31:26.484637 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-652a3cf9-1029-43ef-8b6a-845a1b5b0877 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:26.485639 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-652a3cf9-1029-43ef-8b6a-845a1b5b0877 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:26.486249 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-652a3cf9-1029-43ef-8b6a-845a1b5b0877 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:26.486937 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-652a3cf9-1029-43ef-8b6a-845a1b5b0877 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:26.487385 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-652a3cf9-1029-43ef-8b6a-845a1b5b0877 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:26.487825 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-652a3cf9-1029-43ef-8b6a-845a1b5b0877 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:26.621083 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-652a3cf9-1029-43ef-8b6a-845a1b5b0877 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139dfba82fda43f1a058c60b1a4dc818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e6fee821e7449b92c3df24de169fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:26.628791 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-652a3cf9-1029-43ef-8b6a-845a1b5b0877 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] 10.222.0.17 "GET /compute/v2.1/servers/0d0d6662-98d6-49c6-9149-0f8c4acd0350" status: 200 len: 1502 microversion: 2.1 time: 0.157022 Sep 30 19:31:26.629359 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 183/386] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:26 2022] GET /compute/v2.1/servers/0d0d6662-98d6-49c6-9149-0f8c4acd0350 => generated 1502 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:27.151791 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-d25a8fd4-7f0b-4266-a071-0a52c8253380 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:27.153139 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-d25a8fd4-7f0b-4266-a071-0a52c8253380 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:27.155269 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell0:SELECT=2 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:31:27.161504 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d25a8fd4-7f0b-4266-a071-0a52c8253380 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:27.162069 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d25a8fd4-7f0b-4266-a071-0a52c8253380 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:27.162577 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d25a8fd4-7f0b-4266-a071-0a52c8253380 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:27.163351 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d25a8fd4-7f0b-4266-a071-0a52c8253380 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:27.163881 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d25a8fd4-7f0b-4266-a071-0a52c8253380 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:27.164448 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d25a8fd4-7f0b-4266-a071-0a52c8253380 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:27.185297 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell1:SELECT=100 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:31:27.234367 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-d25a8fd4-7f0b-4266-a071-0a52c8253380 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:27.242377 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-d25a8fd4-7f0b-4266-a071-0a52c8253380 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1187 microversion: 2.1 time: 0.095153 Sep 30 19:31:27.243165 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 204/387] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:27 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1187 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:27.303573 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-b65f1ab8-23f4-475e-8687-7737a89d06a8 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:27.304187 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-b65f1ab8-23f4-475e-8687-7737a89d06a8 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:27.310895 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b65f1ab8-23f4-475e-8687-7737a89d06a8 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:27.311401 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b65f1ab8-23f4-475e-8687-7737a89d06a8 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:27.311822 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b65f1ab8-23f4-475e-8687-7737a89d06a8 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:27.312559 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b65f1ab8-23f4-475e-8687-7737a89d06a8 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:27.313016 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b65f1ab8-23f4-475e-8687-7737a89d06a8 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:27.313441 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b65f1ab8-23f4-475e-8687-7737a89d06a8 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:27.331466 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:31:27.475627 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-b65f1ab8-23f4-475e-8687-7737a89d06a8 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:27.483776 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-b65f1ab8-23f4-475e-8687-7737a89d06a8 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1523 microversion: 2.1 time: 0.184496 Sep 30 19:31:27.484453 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 184/388] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:27 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:27.652826 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-75b75694-5fc7-48a8-9e27-f03da2ca6373 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:27.653473 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-75b75694-5fc7-48a8-9e27-f03da2ca6373 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 0d0d6662-98d6-49c6-9149-0f8c4acd0350] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:27.660078 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-75b75694-5fc7-48a8-9e27-f03da2ca6373 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:27.660542 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-75b75694-5fc7-48a8-9e27-f03da2ca6373 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:27.660983 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-75b75694-5fc7-48a8-9e27-f03da2ca6373 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:27.661676 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-75b75694-5fc7-48a8-9e27-f03da2ca6373 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:27.662128 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-75b75694-5fc7-48a8-9e27-f03da2ca6373 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:27.662553 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-75b75694-5fc7-48a8-9e27-f03da2ca6373 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:27.793485 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-75b75694-5fc7-48a8-9e27-f03da2ca6373 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139dfba82fda43f1a058c60b1a4dc818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e6fee821e7449b92c3df24de169fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:27.804936 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-75b75694-5fc7-48a8-9e27-f03da2ca6373 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] 10.222.0.17 "GET /compute/v2.1/servers/0d0d6662-98d6-49c6-9149-0f8c4acd0350" status: 200 len: 1502 microversion: 2.1 time: 0.156114 Sep 30 19:31:27.808517 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 205/389] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:27 2022] GET /compute/v2.1/servers/0d0d6662-98d6-49c6-9149-0f8c4acd0350 => generated 1502 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:28.265787 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-f2fb9d62-b546-412b-b0b4-1bd86d21da4b tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:28.266867 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-f2fb9d62-b546-412b-b0b4-1bd86d21da4b tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:28.273198 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f2fb9d62-b546-412b-b0b4-1bd86d21da4b tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:28.273679 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f2fb9d62-b546-412b-b0b4-1bd86d21da4b tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:28.274111 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f2fb9d62-b546-412b-b0b4-1bd86d21da4b tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:28.274798 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f2fb9d62-b546-412b-b0b4-1bd86d21da4b tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:28.275251 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f2fb9d62-b546-412b-b0b4-1bd86d21da4b tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:28.275674 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f2fb9d62-b546-412b-b0b4-1bd86d21da4b tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:28.341072 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f2fb9d62-b546-412b-b0b4-1bd86d21da4b tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:28.348647 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-f2fb9d62-b546-412b-b0b4-1bd86d21da4b tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1187 microversion: 2.1 time: 0.087520 Sep 30 19:31:28.349199 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 185/390] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:28 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1187 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:28.506708 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-1961c3e7-df8a-4c7b-a763-01ed7cf39106 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:28.507315 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-1961c3e7-df8a-4c7b-a763-01ed7cf39106 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:28.513179 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1961c3e7-df8a-4c7b-a763-01ed7cf39106 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:28.513667 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1961c3e7-df8a-4c7b-a763-01ed7cf39106 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:28.514100 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1961c3e7-df8a-4c7b-a763-01ed7cf39106 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:28.514793 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1961c3e7-df8a-4c7b-a763-01ed7cf39106 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:28.515245 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1961c3e7-df8a-4c7b-a763-01ed7cf39106 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:28.515667 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1961c3e7-df8a-4c7b-a763-01ed7cf39106 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:28.643649 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-1961c3e7-df8a-4c7b-a763-01ed7cf39106 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:28.651356 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-1961c3e7-df8a-4c7b-a763-01ed7cf39106 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1523 microversion: 2.1 time: 0.148502 Sep 30 19:31:28.651915 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 206/391] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:28 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:28.827512 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-723d5ca8-6442-4d1b-9c32-f4e7fef437f9 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:28.828130 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-723d5ca8-6442-4d1b-9c32-f4e7fef437f9 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 0d0d6662-98d6-49c6-9149-0f8c4acd0350] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:28.834534 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-723d5ca8-6442-4d1b-9c32-f4e7fef437f9 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:28.835019 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-723d5ca8-6442-4d1b-9c32-f4e7fef437f9 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:28.835497 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-723d5ca8-6442-4d1b-9c32-f4e7fef437f9 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:28.836198 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-723d5ca8-6442-4d1b-9c32-f4e7fef437f9 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:28.836757 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-723d5ca8-6442-4d1b-9c32-f4e7fef437f9 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:28.837188 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-723d5ca8-6442-4d1b-9c32-f4e7fef437f9 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:28.986288 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-723d5ca8-6442-4d1b-9c32-f4e7fef437f9 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139dfba82fda43f1a058c60b1a4dc818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e6fee821e7449b92c3df24de169fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:28.990922 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-723d5ca8-6442-4d1b-9c32-f4e7fef437f9 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] 10.222.0.17 "GET /compute/v2.1/servers/0d0d6662-98d6-49c6-9149-0f8c4acd0350" status: 200 len: 1502 microversion: 2.1 time: 0.167287 Sep 30 19:31:28.991475 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 186/392] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:28 2022] GET /compute/v2.1/servers/0d0d6662-98d6-49c6-9149-0f8c4acd0350 => generated 1502 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:29.370803 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-982a4cba-f387-43f1-bccc-58e53847e51e tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:29.371415 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-982a4cba-f387-43f1-bccc-58e53847e51e tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:29.378077 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-982a4cba-f387-43f1-bccc-58e53847e51e tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:29.378566 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-982a4cba-f387-43f1-bccc-58e53847e51e tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:29.379007 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-982a4cba-f387-43f1-bccc-58e53847e51e tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:29.379710 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-982a4cba-f387-43f1-bccc-58e53847e51e tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:29.380170 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-982a4cba-f387-43f1-bccc-58e53847e51e tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:29.380634 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-982a4cba-f387-43f1-bccc-58e53847e51e tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:29.445926 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-982a4cba-f387-43f1-bccc-58e53847e51e tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:29.453524 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-982a4cba-f387-43f1-bccc-58e53847e51e tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1187 microversion: 2.1 time: 0.086504 Sep 30 19:31:29.454119 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 207/393] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:29 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1187 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:29.679356 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-2a9841e7-c4bd-42fe-b88f-168139b6ae2f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:29.680087 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-2a9841e7-c4bd-42fe-b88f-168139b6ae2f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:29.690248 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2a9841e7-c4bd-42fe-b88f-168139b6ae2f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:29.690743 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2a9841e7-c4bd-42fe-b88f-168139b6ae2f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:29.691185 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2a9841e7-c4bd-42fe-b88f-168139b6ae2f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:29.691985 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2a9841e7-c4bd-42fe-b88f-168139b6ae2f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:29.692633 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2a9841e7-c4bd-42fe-b88f-168139b6ae2f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:29.693092 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2a9841e7-c4bd-42fe-b88f-168139b6ae2f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:29.843474 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-2a9841e7-c4bd-42fe-b88f-168139b6ae2f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:29.851586 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-2a9841e7-c4bd-42fe-b88f-168139b6ae2f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1523 microversion: 2.1 time: 0.176979 Sep 30 19:31:29.852231 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 187/394] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:29 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:30.015084 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-bec1ba08-c3f2-476b-8498-ad49cf517469 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:30.015694 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-bec1ba08-c3f2-476b-8498-ad49cf517469 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 0d0d6662-98d6-49c6-9149-0f8c4acd0350] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:30.021468 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-bec1ba08-c3f2-476b-8498-ad49cf517469 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:30.021947 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-bec1ba08-c3f2-476b-8498-ad49cf517469 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:30.022379 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-bec1ba08-c3f2-476b-8498-ad49cf517469 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:30.023068 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-bec1ba08-c3f2-476b-8498-ad49cf517469 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:30.023522 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-bec1ba08-c3f2-476b-8498-ad49cf517469 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:30.023946 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-bec1ba08-c3f2-476b-8498-ad49cf517469 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:30.262538 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-bec1ba08-c3f2-476b-8498-ad49cf517469 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139dfba82fda43f1a058c60b1a4dc818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e6fee821e7449b92c3df24de169fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:30.275182 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-bec1ba08-c3f2-476b-8498-ad49cf517469 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] 10.222.0.17 "GET /compute/v2.1/servers/0d0d6662-98d6-49c6-9149-0f8c4acd0350" status: 200 len: 1502 microversion: 2.1 time: 0.264722 Sep 30 19:31:30.289331 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 208/395] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:30 2022] GET /compute/v2.1/servers/0d0d6662-98d6-49c6-9149-0f8c4acd0350 => generated 1502 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:30.476047 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-b04556d2-3215-45b8-9054-f2efa0cb9f8c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:30.476672 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-b04556d2-3215-45b8-9054-f2efa0cb9f8c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:30.482538 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b04556d2-3215-45b8-9054-f2efa0cb9f8c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:30.483017 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b04556d2-3215-45b8-9054-f2efa0cb9f8c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:30.483447 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b04556d2-3215-45b8-9054-f2efa0cb9f8c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:30.484128 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b04556d2-3215-45b8-9054-f2efa0cb9f8c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:30.484601 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b04556d2-3215-45b8-9054-f2efa0cb9f8c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:30.485528 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b04556d2-3215-45b8-9054-f2efa0cb9f8c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:30.549552 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-b04556d2-3215-45b8-9054-f2efa0cb9f8c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:30.557398 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-b04556d2-3215-45b8-9054-f2efa0cb9f8c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1205 microversion: 2.1 time: 0.085093 Sep 30 19:31:30.557929 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 188/396] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:30 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1205 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:30.877552 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-d5f4dedd-5e5d-49e1-9efc-cc554b843b87 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:30.878163 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-d5f4dedd-5e5d-49e1-9efc-cc554b843b87 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:30.883804 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d5f4dedd-5e5d-49e1-9efc-cc554b843b87 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:30.884281 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d5f4dedd-5e5d-49e1-9efc-cc554b843b87 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:30.884811 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d5f4dedd-5e5d-49e1-9efc-cc554b843b87 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:30.885494 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d5f4dedd-5e5d-49e1-9efc-cc554b843b87 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:30.885961 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d5f4dedd-5e5d-49e1-9efc-cc554b843b87 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:30.886363 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d5f4dedd-5e5d-49e1-9efc-cc554b843b87 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:31.032291 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-d5f4dedd-5e5d-49e1-9efc-cc554b843b87 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:31.043818 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-d5f4dedd-5e5d-49e1-9efc-cc554b843b87 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1523 microversion: 2.1 time: 0.170330 Sep 30 19:31:31.056948 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 209/397] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:30 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:31.299588 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-fd53636e-672a-4d4b-ad8a-f87b8e2d896a tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:31.300200 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-fd53636e-672a-4d4b-ad8a-f87b8e2d896a tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 0d0d6662-98d6-49c6-9149-0f8c4acd0350] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:31.306961 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fd53636e-672a-4d4b-ad8a-f87b8e2d896a tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:31.307448 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fd53636e-672a-4d4b-ad8a-f87b8e2d896a tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:31.308064 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fd53636e-672a-4d4b-ad8a-f87b8e2d896a tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:31.308800 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fd53636e-672a-4d4b-ad8a-f87b8e2d896a tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:31.309243 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fd53636e-672a-4d4b-ad8a-f87b8e2d896a tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:31.309667 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fd53636e-672a-4d4b-ad8a-f87b8e2d896a tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:31.441635 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-fd53636e-672a-4d4b-ad8a-f87b8e2d896a tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139dfba82fda43f1a058c60b1a4dc818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e6fee821e7449b92c3df24de169fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:31.449414 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-fd53636e-672a-4d4b-ad8a-f87b8e2d896a tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] 10.222.0.17 "GET /compute/v2.1/servers/0d0d6662-98d6-49c6-9149-0f8c4acd0350" status: 200 len: 1502 microversion: 2.1 time: 0.154365 Sep 30 19:31:31.449991 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 189/398] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:31 2022] GET /compute/v2.1/servers/0d0d6662-98d6-49c6-9149-0f8c4acd0350 => generated 1502 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:31.580886 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-fb31f9c0-c0b0-4765-accd-c0a1ead5be31 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:31.581426 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-fb31f9c0-c0b0-4765-accd-c0a1ead5be31 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:31.587245 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-fb31f9c0-c0b0-4765-accd-c0a1ead5be31 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:31.587704 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-fb31f9c0-c0b0-4765-accd-c0a1ead5be31 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:31.588134 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-fb31f9c0-c0b0-4765-accd-c0a1ead5be31 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:31.588839 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-fb31f9c0-c0b0-4765-accd-c0a1ead5be31 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:31.589286 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-fb31f9c0-c0b0-4765-accd-c0a1ead5be31 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:31.589709 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-fb31f9c0-c0b0-4765-accd-c0a1ead5be31 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:31.648712 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-fb31f9c0-c0b0-4765-accd-c0a1ead5be31 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:31.656206 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-fb31f9c0-c0b0-4765-accd-c0a1ead5be31 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1205 microversion: 2.1 time: 0.079499 Sep 30 19:31:31.657354 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 210/399] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:31 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1205 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:32.069288 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-a933ffc5-1f6f-41ed-8896-189af05b22f6 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:32.069998 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-a933ffc5-1f6f-41ed-8896-189af05b22f6 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:32.076346 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a933ffc5-1f6f-41ed-8896-189af05b22f6 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:32.080283 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a933ffc5-1f6f-41ed-8896-189af05b22f6 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:32.080887 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a933ffc5-1f6f-41ed-8896-189af05b22f6 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:32.081703 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a933ffc5-1f6f-41ed-8896-189af05b22f6 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:32.082373 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a933ffc5-1f6f-41ed-8896-189af05b22f6 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:32.083774 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a933ffc5-1f6f-41ed-8896-189af05b22f6 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:32.292001 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-a933ffc5-1f6f-41ed-8896-189af05b22f6 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:32.301067 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-a933ffc5-1f6f-41ed-8896-189af05b22f6 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1523 microversion: 2.1 time: 0.235711 Sep 30 19:31:32.301656 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 190/400] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:32 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1523 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:32.472794 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-f8d64676-38cf-41a0-8920-0bdaa47aec59 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:32.474388 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-f8d64676-38cf-41a0-8920-0bdaa47aec59 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 0d0d6662-98d6-49c6-9149-0f8c4acd0350] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:32.481073 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f8d64676-38cf-41a0-8920-0bdaa47aec59 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:32.481789 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f8d64676-38cf-41a0-8920-0bdaa47aec59 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:32.482270 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f8d64676-38cf-41a0-8920-0bdaa47aec59 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:32.482999 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f8d64676-38cf-41a0-8920-0bdaa47aec59 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:32.483797 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f8d64676-38cf-41a0-8920-0bdaa47aec59 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:32.484526 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f8d64676-38cf-41a0-8920-0bdaa47aec59 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:32.646253 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-f8d64676-38cf-41a0-8920-0bdaa47aec59 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139dfba82fda43f1a058c60b1a4dc818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e6fee821e7449b92c3df24de169fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:32.654541 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-f8d64676-38cf-41a0-8920-0bdaa47aec59 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] 10.222.0.17 "GET /compute/v2.1/servers/0d0d6662-98d6-49c6-9149-0f8c4acd0350" status: 200 len: 1502 microversion: 2.1 time: 0.185925 Sep 30 19:31:32.659395 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 211/401] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:32 2022] GET /compute/v2.1/servers/0d0d6662-98d6-49c6-9149-0f8c4acd0350 => generated 1502 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:32.679868 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-d8a0ed18-000c-4258-b3c9-41bfb2659a9c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:32.680416 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-d8a0ed18-000c-4258-b3c9-41bfb2659a9c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:32.687184 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d8a0ed18-000c-4258-b3c9-41bfb2659a9c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:32.687679 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d8a0ed18-000c-4258-b3c9-41bfb2659a9c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:32.688793 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d8a0ed18-000c-4258-b3c9-41bfb2659a9c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:32.689728 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d8a0ed18-000c-4258-b3c9-41bfb2659a9c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:32.690364 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d8a0ed18-000c-4258-b3c9-41bfb2659a9c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:32.691003 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d8a0ed18-000c-4258-b3c9-41bfb2659a9c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:32.831370 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-d8a0ed18-000c-4258-b3c9-41bfb2659a9c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:32.838999 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-d8a0ed18-000c-4258-b3c9-41bfb2659a9c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1273 microversion: 2.1 time: 0.163213 Sep 30 19:31:32.839752 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 191/402] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:32 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1273 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:33.327834 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-d80b924f-89d3-42a0-82a0-643157ee9708 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:33.329463 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-d80b924f-89d3-42a0-82a0-643157ee9708 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:33.339228 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d80b924f-89d3-42a0-82a0-643157ee9708 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:33.340521 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d80b924f-89d3-42a0-82a0-643157ee9708 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:33.342231 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d80b924f-89d3-42a0-82a0-643157ee9708 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:33.345639 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d80b924f-89d3-42a0-82a0-643157ee9708 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:33.347196 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d80b924f-89d3-42a0-82a0-643157ee9708 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:33.347962 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d80b924f-89d3-42a0-82a0-643157ee9708 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:33.615382 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-d80b924f-89d3-42a0-82a0-643157ee9708 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:33.624726 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-d80b924f-89d3-42a0-82a0-643157ee9708 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1503 microversion: 2.1 time: 0.302836 Sep 30 19:31:33.626991 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 212/403] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:33 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1503 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:33.650395 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-4b35bfb7-326d-4ee9-b71a-db8885fdbe3b tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:33.651594 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-4b35bfb7-326d-4ee9-b71a-db8885fdbe3b tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 5fd6c296-8008-4f27-82c0-36839a4eec3f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:33.658212 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4b35bfb7-326d-4ee9-b71a-db8885fdbe3b tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:33.658870 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4b35bfb7-326d-4ee9-b71a-db8885fdbe3b tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:33.659756 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4b35bfb7-326d-4ee9-b71a-db8885fdbe3b tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:33.660647 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4b35bfb7-326d-4ee9-b71a-db8885fdbe3b tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:33.661422 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4b35bfb7-326d-4ee9-b71a-db8885fdbe3b tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:33.662010 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4b35bfb7-326d-4ee9-b71a-db8885fdbe3b tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:33.674888 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [req-5d20e699-a775-4bd0-baf2-fda133951da5 req-34361c70-ee52-4e33-8542-ba8231fdde99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d0d6662-98d6-49c6-9149-0f8c4acd0350", "name": "network-vif-deleted", "tag": "8ddd7bb7-11e2-44a4-9c7c-df0c58a2ab6d"}]} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:31:33.684717 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-5d20e699-a775-4bd0-baf2-fda133951da5 req-34361c70-ee52-4e33-8542-ba8231fdde99 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:33.685200 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-5d20e699-a775-4bd0-baf2-fda133951da5 req-34361c70-ee52-4e33-8542-ba8231fdde99 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:33.685635 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-5d20e699-a775-4bd0-baf2-fda133951da5 req-34361c70-ee52-4e33-8542-ba8231fdde99 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:33.697541 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.compute.server_external_events [req-5d20e699-a775-4bd0-baf2-fda133951da5 req-34361c70-ee52-4e33-8542-ba8231fdde99 service nova] Creating event network-vif-deleted:8ddd7bb7-11e2-44a4-9c7c-df0c58a2ab6d for instance 0d0d6662-98d6-49c6-9149-0f8c4acd0350 on hv-cinder-86001 Sep 30 19:31:33.702825 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [req-5d20e699-a775-4bd0-baf2-fda133951da5 req-34361c70-ee52-4e33-8542-ba8231fdde99 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031669 Sep 30 19:31:33.703566 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 213/404] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:31:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 30 19:31:33.709529 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-e4ca83a6-efb7-42ed-9cc5-1c9d18ff0bf3 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:33.710251 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-e4ca83a6-efb7-42ed-9cc5-1c9d18ff0bf3 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 0d0d6662-98d6-49c6-9149-0f8c4acd0350] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:33.719963 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e4ca83a6-efb7-42ed-9cc5-1c9d18ff0bf3 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:33.720622 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e4ca83a6-efb7-42ed-9cc5-1c9d18ff0bf3 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:33.721074 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e4ca83a6-efb7-42ed-9cc5-1c9d18ff0bf3 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:33.721862 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e4ca83a6-efb7-42ed-9cc5-1c9d18ff0bf3 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:33.722495 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e4ca83a6-efb7-42ed-9cc5-1c9d18ff0bf3 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:33.723631 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e4ca83a6-efb7-42ed-9cc5-1c9d18ff0bf3 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:33.790901 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-e4ca83a6-efb7-42ed-9cc5-1c9d18ff0bf3 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139dfba82fda43f1a058c60b1a4dc818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e6fee821e7449b92c3df24de169fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:33.799419 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-e4ca83a6-efb7-42ed-9cc5-1c9d18ff0bf3 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] 10.222.0.17 "GET /compute/v2.1/servers/0d0d6662-98d6-49c6-9149-0f8c4acd0350" status: 200 len: 1460 microversion: 2.1 time: 0.094056 Sep 30 19:31:33.800173 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 214/405] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:33 2022] GET /compute/v2.1/servers/0d0d6662-98d6-49c6-9149-0f8c4acd0350 => generated 1460 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:33.805027 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [req-26ed02e6-c7dd-4399-a65f-353f9eca35f2 req-67ff1beb-eba1-4b08-8944-e3fd3e1e407b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4d9e349-e05e-43c7-ac04-37d75ee740ab", "tag": "b73129fe-b689-4fff-8b47-dd8833dbebb1"}]} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:31:33.816556 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-26ed02e6-c7dd-4399-a65f-353f9eca35f2 req-67ff1beb-eba1-4b08-8944-e3fd3e1e407b service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:33.817048 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-26ed02e6-c7dd-4399-a65f-353f9eca35f2 req-67ff1beb-eba1-4b08-8944-e3fd3e1e407b service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:33.817774 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-26ed02e6-c7dd-4399-a65f-353f9eca35f2 req-67ff1beb-eba1-4b08-8944-e3fd3e1e407b service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:33.829862 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.compute.server_external_events [req-26ed02e6-c7dd-4399-a65f-353f9eca35f2 req-67ff1beb-eba1-4b08-8944-e3fd3e1e407b service nova] Creating event network-changed:b73129fe-b689-4fff-8b47-dd8833dbebb1 for instance e4d9e349-e05e-43c7-ac04-37d75ee740ab on hv-cinder-86001 Sep 30 19:31:33.834663 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [req-26ed02e6-c7dd-4399-a65f-353f9eca35f2 req-67ff1beb-eba1-4b08-8944-e3fd3e1e407b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033478 Sep 30 19:31:33.835448 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 215/406] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:31:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:31:33.863372 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-f1d56509-37ec-4639-bd9d-0febd1dcc705 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:33.864092 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-f1d56509-37ec-4639-bd9d-0febd1dcc705 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:33.870754 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f1d56509-37ec-4639-bd9d-0febd1dcc705 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:33.871259 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f1d56509-37ec-4639-bd9d-0febd1dcc705 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:33.871707 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f1d56509-37ec-4639-bd9d-0febd1dcc705 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:33.872492 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f1d56509-37ec-4639-bd9d-0febd1dcc705 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:33.872953 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f1d56509-37ec-4639-bd9d-0febd1dcc705 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:33.873392 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f1d56509-37ec-4639-bd9d-0febd1dcc705 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:33.899618 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-4b35bfb7-326d-4ee9-b71a-db8885fdbe3b tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:33.907906 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-4b35bfb7-326d-4ee9-b71a-db8885fdbe3b tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f" status: 200 len: 1516 microversion: 2.1 time: 0.261664 Sep 30 19:31:33.908392 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 192/407] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:33 2022] GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f => generated 1516 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:34.020317 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-f1d56509-37ec-4639-bd9d-0febd1dcc705 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:34.028828 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-f1d56509-37ec-4639-bd9d-0febd1dcc705 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1261 microversion: 2.1 time: 0.169739 Sep 30 19:31:34.030043 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 216/408] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:33 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1261 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:31:34.825288 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-be1e2fb2-1d21-4f49-94a8-3d44bc20fbcf tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:34.826688 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-be1e2fb2-1d21-4f49-94a8-3d44bc20fbcf tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 0d0d6662-98d6-49c6-9149-0f8c4acd0350] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:34.834905 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-be1e2fb2-1d21-4f49-94a8-3d44bc20fbcf tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:34.835628 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-be1e2fb2-1d21-4f49-94a8-3d44bc20fbcf tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:34.836449 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-be1e2fb2-1d21-4f49-94a8-3d44bc20fbcf tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:34.838226 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-be1e2fb2-1d21-4f49-94a8-3d44bc20fbcf tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:34.838960 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-be1e2fb2-1d21-4f49-94a8-3d44bc20fbcf tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:34.839831 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-be1e2fb2-1d21-4f49-94a8-3d44bc20fbcf tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:34.877474 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-be1e2fb2-1d21-4f49-94a8-3d44bc20fbcf tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:34.878654 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-be1e2fb2-1d21-4f49-94a8-3d44bc20fbcf tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:34.879102 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-be1e2fb2-1d21-4f49-94a8-3d44bc20fbcf tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:34.879549 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.objects.instance [None req-be1e2fb2-1d21-4f49-94a8-3d44bc20fbcf tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lazy-loading 'fault' on Instance uuid 0d0d6662-98d6-49c6-9149-0f8c4acd0350 {{(pid=120648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 30 19:31:34.936132 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-be1e2fb2-1d21-4f49-94a8-3d44bc20fbcf tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139dfba82fda43f1a058c60b1a4dc818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e6fee821e7449b92c3df24de169fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:34.945008 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-be1e2fb2-1d21-4f49-94a8-3d44bc20fbcf tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] 10.222.0.17 "GET /compute/v2.1/servers/0d0d6662-98d6-49c6-9149-0f8c4acd0350" status: 200 len: 1303 microversion: 2.1 time: 0.125673 Sep 30 19:31:34.945577 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 193/409] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:34 2022] GET /compute/v2.1/servers/0d0d6662-98d6-49c6-9149-0f8c4acd0350 => generated 1303 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:35.053691 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-eda89dfc-c4a7-4daf-92c3-2ef415d02777 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:35.054300 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-eda89dfc-c4a7-4daf-92c3-2ef415d02777 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:35.060233 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-eda89dfc-c4a7-4daf-92c3-2ef415d02777 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:35.060944 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-eda89dfc-c4a7-4daf-92c3-2ef415d02777 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:35.061378 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-eda89dfc-c4a7-4daf-92c3-2ef415d02777 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:35.062074 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-eda89dfc-c4a7-4daf-92c3-2ef415d02777 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:35.062522 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-eda89dfc-c4a7-4daf-92c3-2ef415d02777 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:35.063643 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-eda89dfc-c4a7-4daf-92c3-2ef415d02777 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:35.200155 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-eda89dfc-c4a7-4daf-92c3-2ef415d02777 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:35.208408 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-eda89dfc-c4a7-4daf-92c3-2ef415d02777 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1261 microversion: 2.1 time: 0.158678 Sep 30 19:31:35.208959 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 217/410] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:35 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:35.378676 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-61c64ea8-512f-4d19-9d77-57c0eedd91cc tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:31:35.381006 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-61c64ea8-512f-4d19-9d77-57c0eedd91cc tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 5fd6c296-8008-4f27-82c0-36839a4eec3f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:35.386967 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-61c64ea8-512f-4d19-9d77-57c0eedd91cc tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:35.387445 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-61c64ea8-512f-4d19-9d77-57c0eedd91cc tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:35.387876 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-61c64ea8-512f-4d19-9d77-57c0eedd91cc tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:35.388584 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-61c64ea8-512f-4d19-9d77-57c0eedd91cc tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:35.389040 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-61c64ea8-512f-4d19-9d77-57c0eedd91cc tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:35.389457 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-61c64ea8-512f-4d19-9d77-57c0eedd91cc tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:35.413095 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.objects.instance [None req-61c64ea8-512f-4d19-9d77-57c0eedd91cc tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lazy-loading 'flavor' on Instance uuid 5fd6c296-8008-4f27-82c0-36839a4eec3f {{(pid=120648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 30 19:31:35.489885 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-61c64ea8-512f-4d19-9d77-57c0eedd91cc tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "POST /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f/action" status: 200 len: 32 microversion: 2.1 time: 0.115556 Sep 30 19:31:35.490475 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 194/411] 10.222.0.17 () {60 vars in 1278 bytes} [Fri Sep 30 19:31:35 2022] POST /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f/action => generated 32 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 30 19:31:35.499842 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-98bcccc6-a1b1-4340-a3b4-de1e806ed480 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:35.501116 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-98bcccc6-a1b1-4340-a3b4-de1e806ed480 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 5fd6c296-8008-4f27-82c0-36839a4eec3f] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:35.507209 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-98bcccc6-a1b1-4340-a3b4-de1e806ed480 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:35.507777 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-98bcccc6-a1b1-4340-a3b4-de1e806ed480 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:35.508299 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-98bcccc6-a1b1-4340-a3b4-de1e806ed480 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:35.509097 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-98bcccc6-a1b1-4340-a3b4-de1e806ed480 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:35.509621 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-98bcccc6-a1b1-4340-a3b4-de1e806ed480 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:35.510131 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-98bcccc6-a1b1-4340-a3b4-de1e806ed480 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:35.644442 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-98bcccc6-a1b1-4340-a3b4-de1e806ed480 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:35.652277 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-98bcccc6-a1b1-4340-a3b4-de1e806ed480 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f" status: 200 len: 1522 microversion: 2.1 time: 0.156244 Sep 30 19:31:35.652946 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 218/412] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:35 2022] GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:35.968217 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-055ac19e-2508-410d-bd19-1e46c5822f06 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:35.969673 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-055ac19e-2508-410d-bd19-1e46c5822f06 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 0d0d6662-98d6-49c6-9149-0f8c4acd0350] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:35.976224 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-055ac19e-2508-410d-bd19-1e46c5822f06 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:35.976749 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-055ac19e-2508-410d-bd19-1e46c5822f06 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:35.977184 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-055ac19e-2508-410d-bd19-1e46c5822f06 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:35.977868 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-055ac19e-2508-410d-bd19-1e46c5822f06 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:35.978321 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-055ac19e-2508-410d-bd19-1e46c5822f06 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:35.978743 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-055ac19e-2508-410d-bd19-1e46c5822f06 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:35.993084 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.wsgi [None req-055ac19e-2508-410d-bd19-1e46c5822f06 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] HTTP exception thrown: Instance 0d0d6662-98d6-49c6-9149-0f8c4acd0350 could not be found. Sep 30 19:31:35.994696 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-055ac19e-2508-410d-bd19-1e46c5822f06 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Request method failure captured: Sep 30 19:31:35.994696 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: request: GET /compute/v2.1/servers/0d0d6662-98d6-49c6-9149-0f8c4acd0350 HTTP/1.1 Sep 30 19:31:35.994696 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 30 19:31:35.994696 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 30 19:31:35.994696 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Connection: close Sep 30 19:31:35.994696 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Length: 0 Sep 30 19:31:35.994696 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 30 19:31:35.994696 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Host: 10.222.0.17 Sep 30 19:31:35.994696 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 30 19:31:35.994696 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 30 19:31:35.994696 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjN0P0rLmu0GeW5j6peKmJZmUwspd61G1WGW9dbru0_IhYSyJSItBZm00r7YnPSnSBzHOxekp9DvtuPx8df8BItrGTQ2XiRkH14Tt16v5dvyKLHsXmg3V2g7IF-lFJpyF2LlCEI5Aqc87sTW8OtcADZPcmrHBtshiZmhNlu39mjKCNSyI Sep 30 19:31:35.994696 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 30 19:31:35.994696 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 30 19:31:35.994696 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 30 19:31:35.994696 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 30 19:31:35.994696 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 30 19:31:35.994696 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 30 19:31:35.994696 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Id: 08e6fee821e7449b92c3df24de169fbc Sep 30 19:31:35.994696 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-VolumesActionsTest-1544322723 Sep 30 19:31:35.994696 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 30 19:31:35.994696 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 30 19:31:35.996253 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/08e6fee821e7449b92c3df24de169fbc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/08e6fee821e7449b92c3df24de169fbc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/08e6fee821e7449b92c3df24de169fbc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_08e6fee821e7449b92c3df24de169fbc"}]}] Sep 30 19:31:35.996253 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-VolumesActionsTest-1544322723 Sep 30 19:31:35.996253 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Id: 08e6fee821e7449b92c3df24de169fbc Sep 30 19:31:35.996253 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-VolumesActionsTest-1544322723 Sep 30 19:31:35.996253 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User: tempest-VolumesActionsTest-1544322723-project Sep 30 19:31:35.996253 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 30 19:31:35.996253 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 30 19:31:35.996253 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Id: 139dfba82fda43f1a058c60b1a4dc818 Sep 30 19:31:35.996253 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-VolumesActionsTest-1544322723-project Sep 30 19:31:35.996253 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: method: > Sep 30 19:31:35.996253 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: exception: Instance 0d0d6662-98d6-49c6-9149-0f8c4acd0350 could not be found. Sep 30 19:31:35.996253 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: action_args: {'id': '0d0d6662-98d6-49c6-9149-0f8c4acd0350'} Sep 30 19:31:35.997338 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:31:35.997338 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:31:35.997338 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 30 19:31:35.997338 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 30 19:31:35.997338 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 30 19:31:35.997338 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 30 19:31:35.997338 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 30 19:31:35.997338 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 30 19:31:35.997338 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 30 19:31:35.997338 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 30 19:31:35.997338 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d0d6662-98d6-49c6-9149-0f8c4acd0350 could not be found. Sep 30 19:31:35.997338 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:31:35.997338 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:31:35.997338 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:31:35.997338 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:31:35.997338 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:31:35.997338 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:31:35.997338 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:31:35.997338 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:31:35.997338 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:31:35.998757 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:31:35.998757 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 30 19:31:35.998757 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 30 19:31:35.998757 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 30 19:31:35.998757 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 30 19:31:35.998757 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 30 19:31:35.998757 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 30 19:31:35.998757 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d0d6662-98d6-49c6-9149-0f8c4acd0350 could not be found. Sep 30 19:31:35.998757 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:31:35.998757 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:31:35.998757 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:31:35.998757 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:31:35.998757 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:31:35.998757 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:31:35.998757 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:31:35.998757 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:31:35.998757 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d0d6662-98d6-49c6-9149-0f8c4acd0350 could not be found. Sep 30 19:31:35.998757 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:31:36.001162 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-055ac19e-2508-410d-bd19-1e46c5822f06 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Returning 404 to user: Instance 0d0d6662-98d6-49c6-9149-0f8c4acd0350 could not be found. {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:31:36.001162 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-055ac19e-2508-410d-bd19-1e46c5822f06 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] 10.222.0.17 "GET /compute/v2.1/servers/0d0d6662-98d6-49c6-9149-0f8c4acd0350" status: 404 len: 111 microversion: 2.1 time: 0.032199 Sep 30 19:31:36.001162 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 195/413] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:35 2022] GET /compute/v2.1/servers/0d0d6662-98d6-49c6-9149-0f8c4acd0350 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 30 19:31:36.152066 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-6afe087c-69e8-4997-a2dc-645742e0d492 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1454649393", "imageRef": "7714d055-7d2c-4f56-9b14-45324361e286", "flavorRef": "452", "networks": [{"uuid": "31acc055-7d21-4cd0-ab1f-5c4c3adcffb8"}]}} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:31:36.204899 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.network.neutron [None req-6afe087c-69e8-4997-a2dc-645742e0d492 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] validate_networks() for [('31acc055-7d21-4cd0-ab1f-5c4c3adcffb8', None, None, None, None, None)] {{(pid=120649) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 30 19:31:36.230157 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-755eaed4-bbb8-432a-bf08-7bbf588036c4 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:36.230770 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-755eaed4-bbb8-432a-bf08-7bbf588036c4 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:36.236613 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-755eaed4-bbb8-432a-bf08-7bbf588036c4 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:36.237085 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-755eaed4-bbb8-432a-bf08-7bbf588036c4 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:36.237512 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-755eaed4-bbb8-432a-bf08-7bbf588036c4 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:36.238196 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-755eaed4-bbb8-432a-bf08-7bbf588036c4 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:36.238646 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-755eaed4-bbb8-432a-bf08-7bbf588036c4 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:36.239064 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-755eaed4-bbb8-432a-bf08-7bbf588036c4 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:36.378469 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-755eaed4-bbb8-432a-bf08-7bbf588036c4 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:36.386108 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-755eaed4-bbb8-432a-bf08-7bbf588036c4 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1261 microversion: 2.1 time: 0.159847 Sep 30 19:31:36.387181 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 196/414] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:36 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:31:36.553032 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.virt.hardware [None req-6afe087c-69e8-4997-a2dc-645742e0d492 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Flavor limits 0:0:0 {{(pid=120649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 30 19:31:36.553454 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.virt.hardware [None req-6afe087c-69e8-4997-a2dc-645742e0d492 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Image limits 0:0:0 {{(pid=120649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 30 19:31:36.553927 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.virt.hardware [None req-6afe087c-69e8-4997-a2dc-645742e0d492 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Flavor pref 0:0:0 {{(pid=120649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 30 19:31:36.554334 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.virt.hardware [None req-6afe087c-69e8-4997-a2dc-645742e0d492 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Image pref 0:0:0 {{(pid=120649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 30 19:31:36.554743 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.virt.hardware [None req-6afe087c-69e8-4997-a2dc-645742e0d492 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 30 19:31:36.563919 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6afe087c-69e8-4997-a2dc-645742e0d492 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:36.564436 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6afe087c-69e8-4997-a2dc-645742e0d492 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:36.564871 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6afe087c-69e8-4997-a2dc-645742e0d492 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:36.565595 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6afe087c-69e8-4997-a2dc-645742e0d492 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:36.566076 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6afe087c-69e8-4997-a2dc-645742e0d492 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:36.566534 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6afe087c-69e8-4997-a2dc-645742e0d492 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:36.584017 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.quota [None req-6afe087c-69e8-4997-a2dc-645742e0d492 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Getting quotas for project 08e6fee821e7449b92c3df24de169fbc. Resources: {'instances', 'ram', 'cores'} {{(pid=120649) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 30 19:31:36.588317 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.quota [None req-6afe087c-69e8-4997-a2dc-645742e0d492 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Getting quotas for user 139dfba82fda43f1a058c60b1a4dc818 and project 08e6fee821e7449b92c3df24de169fbc. Resources: {'instances', 'ram', 'cores'} {{(pid=120649) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 30 19:31:36.602185 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-6afe087c-69e8-4997-a2dc-645742e0d492 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Going to run 1 instances... {{(pid=120649) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 30 19:31:36.604534 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-6afe087c-69e8-4997-a2dc-645742e0d492 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 64cf2b54-6641-405a-bc74-75509e41561f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7714d055-7d2c-4f56-9b14-45324361e286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 30 19:31:36.649802 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-6afe087c-69e8-4997-a2dc-645742e0d492 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.502026 Sep 30 19:31:36.650483 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 219/415] 10.222.0.17 () {60 vars in 1147 bytes} [Fri Sep 30 19:31:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 503 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 30 19:31:36.662627 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-50159b11-8757-409f-867f-9a016515e4df tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:36.663868 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-50159b11-8757-409f-867f-9a016515e4df tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 64cf2b54-6641-405a-bc74-75509e41561f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:36.675490 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-744ceeeb-0ec1-4cef-8510-409d4885f630 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:36.676168 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-744ceeeb-0ec1-4cef-8510-409d4885f630 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 5fd6c296-8008-4f27-82c0-36839a4eec3f] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:36.683225 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-744ceeeb-0ec1-4cef-8510-409d4885f630 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:36.683798 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-744ceeeb-0ec1-4cef-8510-409d4885f630 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:36.684289 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-744ceeeb-0ec1-4cef-8510-409d4885f630 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:36.688583 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-744ceeeb-0ec1-4cef-8510-409d4885f630 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:36.689111 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-744ceeeb-0ec1-4cef-8510-409d4885f630 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:36.689556 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-744ceeeb-0ec1-4cef-8510-409d4885f630 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:36.727454 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-50159b11-8757-409f-867f-9a016515e4df tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139dfba82fda43f1a058c60b1a4dc818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e6fee821e7449b92c3df24de169fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:36.736624 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-50159b11-8757-409f-867f-9a016515e4df tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] 10.222.0.17 "GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f" status: 200 len: 1214 microversion: 2.1 time: 0.078381 Sep 30 19:31:36.737864 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 197/416] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:36 2022] GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:36.870561 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-744ceeeb-0ec1-4cef-8510-409d4885f630 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:36.881275 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-744ceeeb-0ec1-4cef-8510-409d4885f630 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f" status: 200 len: 1522 microversion: 2.1 time: 0.210183 Sep 30 19:31:36.881896 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 220/417] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:36 2022] GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:31:37.411100 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-cb717578-b16f-4bdf-bb72-111552d15c59 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:37.412190 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-cb717578-b16f-4bdf-bb72-111552d15c59 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:37.419283 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cb717578-b16f-4bdf-bb72-111552d15c59 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:37.419952 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cb717578-b16f-4bdf-bb72-111552d15c59 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:37.420424 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cb717578-b16f-4bdf-bb72-111552d15c59 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:37.421215 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cb717578-b16f-4bdf-bb72-111552d15c59 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:37.421846 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cb717578-b16f-4bdf-bb72-111552d15c59 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:37.422911 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cb717578-b16f-4bdf-bb72-111552d15c59 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:37.552072 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-cb717578-b16f-4bdf-bb72-111552d15c59 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:37.559684 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-cb717578-b16f-4bdf-bb72-111552d15c59 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1261 microversion: 2.1 time: 0.154460 Sep 30 19:31:37.560244 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 198/418] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:37 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:37.761319 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-6c1b2a6f-1650-4eac-9e70-b67608dd5f9b tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:37.761931 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-6c1b2a6f-1650-4eac-9e70-b67608dd5f9b tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 64cf2b54-6641-405a-bc74-75509e41561f] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:37.767733 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6c1b2a6f-1650-4eac-9e70-b67608dd5f9b tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:37.768218 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6c1b2a6f-1650-4eac-9e70-b67608dd5f9b tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:37.768691 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6c1b2a6f-1650-4eac-9e70-b67608dd5f9b tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:37.769387 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6c1b2a6f-1650-4eac-9e70-b67608dd5f9b tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:37.769842 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6c1b2a6f-1650-4eac-9e70-b67608dd5f9b tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:37.770270 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6c1b2a6f-1650-4eac-9e70-b67608dd5f9b tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:37.836150 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-6c1b2a6f-1650-4eac-9e70-b67608dd5f9b tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139dfba82fda43f1a058c60b1a4dc818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e6fee821e7449b92c3df24de169fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:37.844098 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-6c1b2a6f-1650-4eac-9e70-b67608dd5f9b tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] 10.222.0.17 "GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f" status: 200 len: 1266 microversion: 2.1 time: 0.086770 Sep 30 19:31:37.844860 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 221/419] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:37 2022] GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:37.905422 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-939cf25e-ccbc-4292-ac17-554bf438da51 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:37.906063 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-939cf25e-ccbc-4292-ac17-554bf438da51 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 5fd6c296-8008-4f27-82c0-36839a4eec3f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:37.912837 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-939cf25e-ccbc-4292-ac17-554bf438da51 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:37.913314 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-939cf25e-ccbc-4292-ac17-554bf438da51 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:37.913746 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-939cf25e-ccbc-4292-ac17-554bf438da51 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:37.914474 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-939cf25e-ccbc-4292-ac17-554bf438da51 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:37.914925 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-939cf25e-ccbc-4292-ac17-554bf438da51 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:37.915343 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-939cf25e-ccbc-4292-ac17-554bf438da51 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:38.045010 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-939cf25e-ccbc-4292-ac17-554bf438da51 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:38.053768 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-939cf25e-ccbc-4292-ac17-554bf438da51 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f" status: 200 len: 1522 microversion: 2.1 time: 0.152096 Sep 30 19:31:38.054311 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 199/420] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:37 2022] GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:38.583256 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-3d1ff602-9821-4847-83e4-79421c798d36 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:38.583888 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-3d1ff602-9821-4847-83e4-79421c798d36 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:38.589754 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3d1ff602-9821-4847-83e4-79421c798d36 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:38.590226 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3d1ff602-9821-4847-83e4-79421c798d36 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:38.590659 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3d1ff602-9821-4847-83e4-79421c798d36 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:38.591340 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3d1ff602-9821-4847-83e4-79421c798d36 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:38.591787 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3d1ff602-9821-4847-83e4-79421c798d36 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:38.592205 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3d1ff602-9821-4847-83e4-79421c798d36 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:38.717953 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-3d1ff602-9821-4847-83e4-79421c798d36 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:38.726086 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-3d1ff602-9821-4847-83e4-79421c798d36 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1261 microversion: 2.1 time: 0.147146 Sep 30 19:31:38.726635 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 222/421] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:38 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1261 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:38.868007 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-06116aa9-570e-40fe-a06f-69cef40b5b5e tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:38.868645 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-06116aa9-570e-40fe-a06f-69cef40b5b5e tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 64cf2b54-6641-405a-bc74-75509e41561f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:38.874494 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-06116aa9-570e-40fe-a06f-69cef40b5b5e tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:38.874968 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-06116aa9-570e-40fe-a06f-69cef40b5b5e tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:38.875393 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-06116aa9-570e-40fe-a06f-69cef40b5b5e tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:38.876597 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-06116aa9-570e-40fe-a06f-69cef40b5b5e tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:38.877044 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-06116aa9-570e-40fe-a06f-69cef40b5b5e tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:38.877462 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-06116aa9-570e-40fe-a06f-69cef40b5b5e tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:38.895137 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:31:38.944359 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-06116aa9-570e-40fe-a06f-69cef40b5b5e tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139dfba82fda43f1a058c60b1a4dc818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e6fee821e7449b92c3df24de169fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:38.951798 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-06116aa9-570e-40fe-a06f-69cef40b5b5e tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] 10.222.0.17 "GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f" status: 200 len: 1266 microversion: 2.1 time: 0.087561 Sep 30 19:31:38.952348 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 200/422] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:38 2022] GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:39.075278 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-8b9f2f27-0593-410b-8b28-2336b1ea9eda tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:39.075885 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-8b9f2f27-0593-410b-8b28-2336b1ea9eda tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 5fd6c296-8008-4f27-82c0-36839a4eec3f] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:39.082592 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8b9f2f27-0593-410b-8b28-2336b1ea9eda tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:39.083113 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8b9f2f27-0593-410b-8b28-2336b1ea9eda tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:39.083558 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8b9f2f27-0593-410b-8b28-2336b1ea9eda tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:39.084264 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8b9f2f27-0593-410b-8b28-2336b1ea9eda tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:39.084756 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8b9f2f27-0593-410b-8b28-2336b1ea9eda tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:39.085193 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8b9f2f27-0593-410b-8b28-2336b1ea9eda tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:39.089206 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell1:SELECT=100 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:31:39.217950 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-8b9f2f27-0593-410b-8b28-2336b1ea9eda tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:39.226191 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-8b9f2f27-0593-410b-8b28-2336b1ea9eda tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f" status: 200 len: 1522 microversion: 2.1 time: 0.154775 Sep 30 19:31:39.226742 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 223/423] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:39 2022] GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:39.748586 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-9af65899-5d5e-4400-ae35-4f1eaaa6b956 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:39.749120 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-9af65899-5d5e-4400-ae35-4f1eaaa6b956 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:39.754996 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9af65899-5d5e-4400-ae35-4f1eaaa6b956 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:39.755477 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9af65899-5d5e-4400-ae35-4f1eaaa6b956 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:39.755909 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9af65899-5d5e-4400-ae35-4f1eaaa6b956 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:39.756627 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9af65899-5d5e-4400-ae35-4f1eaaa6b956 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:39.757081 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9af65899-5d5e-4400-ae35-4f1eaaa6b956 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:39.757503 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9af65899-5d5e-4400-ae35-4f1eaaa6b956 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:39.883409 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-9af65899-5d5e-4400-ae35-4f1eaaa6b956 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:39.891035 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-9af65899-5d5e-4400-ae35-4f1eaaa6b956 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1261 microversion: 2.1 time: 0.146386 Sep 30 19:31:39.891599 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 201/424] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:39 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1261 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:39.975528 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-e3e148ce-e1f6-430c-b21d-b78b10b9c1b3 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:39.976131 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-e3e148ce-e1f6-430c-b21d-b78b10b9c1b3 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 64cf2b54-6641-405a-bc74-75509e41561f] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:39.982146 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e3e148ce-e1f6-430c-b21d-b78b10b9c1b3 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:39.982625 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e3e148ce-e1f6-430c-b21d-b78b10b9c1b3 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:39.983079 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e3e148ce-e1f6-430c-b21d-b78b10b9c1b3 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:39.983770 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e3e148ce-e1f6-430c-b21d-b78b10b9c1b3 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:39.984204 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e3e148ce-e1f6-430c-b21d-b78b10b9c1b3 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:39.984651 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e3e148ce-e1f6-430c-b21d-b78b10b9c1b3 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:40.045617 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-e3e148ce-e1f6-430c-b21d-b78b10b9c1b3 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139dfba82fda43f1a058c60b1a4dc818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e6fee821e7449b92c3df24de169fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:40.053180 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-e3e148ce-e1f6-430c-b21d-b78b10b9c1b3 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] 10.222.0.17 "GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f" status: 200 len: 1266 microversion: 2.1 time: 0.081461 Sep 30 19:31:40.053724 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 224/425] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:39 2022] GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:40.249187 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-7261c8e2-6869-4bd0-9550-12410580a96c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:40.249818 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-7261c8e2-6869-4bd0-9550-12410580a96c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 5fd6c296-8008-4f27-82c0-36839a4eec3f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:40.256190 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7261c8e2-6869-4bd0-9550-12410580a96c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:40.256705 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7261c8e2-6869-4bd0-9550-12410580a96c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:40.257142 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7261c8e2-6869-4bd0-9550-12410580a96c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:40.257827 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7261c8e2-6869-4bd0-9550-12410580a96c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:40.258280 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7261c8e2-6869-4bd0-9550-12410580a96c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:40.258704 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7261c8e2-6869-4bd0-9550-12410580a96c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:40.382806 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-7261c8e2-6869-4bd0-9550-12410580a96c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:40.390575 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-7261c8e2-6869-4bd0-9550-12410580a96c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f" status: 200 len: 1522 microversion: 2.1 time: 0.145278 Sep 30 19:31:40.391138 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 202/426] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:40 2022] GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:40.913413 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-dce80d60-01b7-4484-9289-99b44367cd84 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:40.914052 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-dce80d60-01b7-4484-9289-99b44367cd84 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:40.919950 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-dce80d60-01b7-4484-9289-99b44367cd84 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:40.920469 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-dce80d60-01b7-4484-9289-99b44367cd84 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:40.920905 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-dce80d60-01b7-4484-9289-99b44367cd84 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:40.921592 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-dce80d60-01b7-4484-9289-99b44367cd84 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:40.922044 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-dce80d60-01b7-4484-9289-99b44367cd84 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:40.922468 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-dce80d60-01b7-4484-9289-99b44367cd84 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:41.051731 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-dce80d60-01b7-4484-9289-99b44367cd84 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:41.059446 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-dce80d60-01b7-4484-9289-99b44367cd84 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1261 microversion: 2.1 time: 0.150100 Sep 30 19:31:41.060026 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 225/427] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:40 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1261 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:41.077449 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e91e62a9-ad09-403a-8987-de97f4ced6e1 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:41.078054 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-e91e62a9-ad09-403a-8987-de97f4ced6e1 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 64cf2b54-6641-405a-bc74-75509e41561f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:41.083839 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e91e62a9-ad09-403a-8987-de97f4ced6e1 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:41.084322 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e91e62a9-ad09-403a-8987-de97f4ced6e1 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:41.084782 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e91e62a9-ad09-403a-8987-de97f4ced6e1 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:41.085464 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e91e62a9-ad09-403a-8987-de97f4ced6e1 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:41.085913 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e91e62a9-ad09-403a-8987-de97f4ced6e1 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:41.086335 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e91e62a9-ad09-403a-8987-de97f4ced6e1 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:41.148841 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-e91e62a9-ad09-403a-8987-de97f4ced6e1 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139dfba82fda43f1a058c60b1a4dc818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e6fee821e7449b92c3df24de169fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:41.156330 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-e91e62a9-ad09-403a-8987-de97f4ced6e1 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] 10.222.0.17 "GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f" status: 200 len: 1266 microversion: 2.1 time: 0.082643 Sep 30 19:31:41.156986 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 203/428] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:41 2022] GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f => generated 1266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:41.414498 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-ffbe3a4e-338f-429e-8d65-7865d999e709 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:41.415105 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-ffbe3a4e-338f-429e-8d65-7865d999e709 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 5fd6c296-8008-4f27-82c0-36839a4eec3f] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:41.420947 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ffbe3a4e-338f-429e-8d65-7865d999e709 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:41.421420 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ffbe3a4e-338f-429e-8d65-7865d999e709 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:41.421847 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ffbe3a4e-338f-429e-8d65-7865d999e709 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:41.422525 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ffbe3a4e-338f-429e-8d65-7865d999e709 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:41.422973 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ffbe3a4e-338f-429e-8d65-7865d999e709 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:41.423394 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ffbe3a4e-338f-429e-8d65-7865d999e709 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:41.549394 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-ffbe3a4e-338f-429e-8d65-7865d999e709 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:41.557220 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-ffbe3a4e-338f-429e-8d65-7865d999e709 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f" status: 200 len: 1522 microversion: 2.1 time: 0.146531 Sep 30 19:31:41.557774 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 226/429] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:41 2022] GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:42.082748 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-712e7fbd-bfb8-46ec-9348-b418704df79a tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:42.083364 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-712e7fbd-bfb8-46ec-9348-b418704df79a tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:42.089984 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-712e7fbd-bfb8-46ec-9348-b418704df79a tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:42.090474 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-712e7fbd-bfb8-46ec-9348-b418704df79a tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:42.090952 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-712e7fbd-bfb8-46ec-9348-b418704df79a tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:42.091650 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-712e7fbd-bfb8-46ec-9348-b418704df79a tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:42.092547 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-712e7fbd-bfb8-46ec-9348-b418704df79a tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:42.093120 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-712e7fbd-bfb8-46ec-9348-b418704df79a tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:42.181423 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-d725656c-a639-4be9-80e7-44d8d7a174d1 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:42.182649 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-d725656c-a639-4be9-80e7-44d8d7a174d1 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 64cf2b54-6641-405a-bc74-75509e41561f] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:42.190029 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d725656c-a639-4be9-80e7-44d8d7a174d1 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:42.191618 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d725656c-a639-4be9-80e7-44d8d7a174d1 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:42.192059 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d725656c-a639-4be9-80e7-44d8d7a174d1 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:42.192950 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d725656c-a639-4be9-80e7-44d8d7a174d1 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:42.194149 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d725656c-a639-4be9-80e7-44d8d7a174d1 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:42.194582 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d725656c-a639-4be9-80e7-44d8d7a174d1 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:42.263097 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-d725656c-a639-4be9-80e7-44d8d7a174d1 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139dfba82fda43f1a058c60b1a4dc818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e6fee821e7449b92c3df24de169fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:42.271044 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-d725656c-a639-4be9-80e7-44d8d7a174d1 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] 10.222.0.17 "GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f" status: 200 len: 1272 microversion: 2.1 time: 0.095069 Sep 30 19:31:42.271854 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 227/430] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:42 2022] GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f => generated 1272 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:42.308013 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-712e7fbd-bfb8-46ec-9348-b418704df79a tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:42.318021 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-712e7fbd-bfb8-46ec-9348-b418704df79a tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1261 microversion: 2.1 time: 0.239756 Sep 30 19:31:42.318604 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 204/431] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:42 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1261 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:42.580397 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-e267cfc0-4c38-4661-87c7-44de55390b4c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:42.580970 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-e267cfc0-4c38-4661-87c7-44de55390b4c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 5fd6c296-8008-4f27-82c0-36839a4eec3f] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:42.586937 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e267cfc0-4c38-4661-87c7-44de55390b4c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:42.587425 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e267cfc0-4c38-4661-87c7-44de55390b4c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:42.587861 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e267cfc0-4c38-4661-87c7-44de55390b4c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:42.588589 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e267cfc0-4c38-4661-87c7-44de55390b4c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:42.589050 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e267cfc0-4c38-4661-87c7-44de55390b4c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:42.589479 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e267cfc0-4c38-4661-87c7-44de55390b4c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:42.742470 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-e267cfc0-4c38-4661-87c7-44de55390b4c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:42.752379 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-e267cfc0-4c38-4661-87c7-44de55390b4c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f" status: 200 len: 1522 microversion: 2.1 time: 0.175700 Sep 30 19:31:42.754316 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 228/432] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:42 2022] GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:43.297110 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-962a572e-7f7b-45b2-8325-693c32d838e3 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:43.298458 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-962a572e-7f7b-45b2-8325-693c32d838e3 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 64cf2b54-6641-405a-bc74-75509e41561f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:43.306447 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-962a572e-7f7b-45b2-8325-693c32d838e3 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:43.307020 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-962a572e-7f7b-45b2-8325-693c32d838e3 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:43.307369 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-962a572e-7f7b-45b2-8325-693c32d838e3 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:43.308339 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-962a572e-7f7b-45b2-8325-693c32d838e3 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:43.308706 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-962a572e-7f7b-45b2-8325-693c32d838e3 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:43.309516 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-962a572e-7f7b-45b2-8325-693c32d838e3 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:43.342319 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-b908b7bf-b6c1-4b9d-aa80-c172096ddafe tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:43.342925 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-b908b7bf-b6c1-4b9d-aa80-c172096ddafe tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:43.349768 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b908b7bf-b6c1-4b9d-aa80-c172096ddafe tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:43.350249 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b908b7bf-b6c1-4b9d-aa80-c172096ddafe tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:43.350861 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b908b7bf-b6c1-4b9d-aa80-c172096ddafe tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:43.351753 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b908b7bf-b6c1-4b9d-aa80-c172096ddafe tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:43.352215 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b908b7bf-b6c1-4b9d-aa80-c172096ddafe tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:43.355160 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b908b7bf-b6c1-4b9d-aa80-c172096ddafe tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:43.448103 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-962a572e-7f7b-45b2-8325-693c32d838e3 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139dfba82fda43f1a058c60b1a4dc818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e6fee821e7449b92c3df24de169fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:43.456832 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-962a572e-7f7b-45b2-8325-693c32d838e3 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] 10.222.0.17 "GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f" status: 200 len: 1314 microversion: 2.1 time: 0.164782 Sep 30 19:31:43.460440 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 205/433] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:43 2022] GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:43.498223 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-b908b7bf-b6c1-4b9d-aa80-c172096ddafe tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:43.509128 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-b908b7bf-b6c1-4b9d-aa80-c172096ddafe tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1261 microversion: 2.1 time: 0.170950 Sep 30 19:31:43.512139 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 229/434] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:43 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1261 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:31:43.778064 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-5092cb75-b7eb-4311-9df0-cd4359e1f984 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:43.778597 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-5092cb75-b7eb-4311-9df0-cd4359e1f984 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 5fd6c296-8008-4f27-82c0-36839a4eec3f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:43.784655 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5092cb75-b7eb-4311-9df0-cd4359e1f984 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:43.785135 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5092cb75-b7eb-4311-9df0-cd4359e1f984 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:43.785567 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5092cb75-b7eb-4311-9df0-cd4359e1f984 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:43.786247 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5092cb75-b7eb-4311-9df0-cd4359e1f984 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:43.786696 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5092cb75-b7eb-4311-9df0-cd4359e1f984 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:43.787112 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5092cb75-b7eb-4311-9df0-cd4359e1f984 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:43.950966 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-5092cb75-b7eb-4311-9df0-cd4359e1f984 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:43.959103 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-5092cb75-b7eb-4311-9df0-cd4359e1f984 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f" status: 200 len: 1522 microversion: 2.1 time: 0.184933 Sep 30 19:31:43.959760 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 206/435] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:43 2022] GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:44.480969 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-67cf8727-1635-43d9-a809-371be5112429 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:44.481686 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-67cf8727-1635-43d9-a809-371be5112429 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 64cf2b54-6641-405a-bc74-75509e41561f] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:44.489989 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-67cf8727-1635-43d9-a809-371be5112429 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:44.490726 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-67cf8727-1635-43d9-a809-371be5112429 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:44.491385 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-67cf8727-1635-43d9-a809-371be5112429 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:44.492689 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-67cf8727-1635-43d9-a809-371be5112429 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:44.493352 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-67cf8727-1635-43d9-a809-371be5112429 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:44.493877 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-67cf8727-1635-43d9-a809-371be5112429 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:44.543129 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-74f4d9f3-9458-44c3-9a5c-79396b53220a tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:44.543817 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-74f4d9f3-9458-44c3-9a5c-79396b53220a tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:44.552192 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-74f4d9f3-9458-44c3-9a5c-79396b53220a tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:44.552711 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-74f4d9f3-9458-44c3-9a5c-79396b53220a tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:44.553149 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-74f4d9f3-9458-44c3-9a5c-79396b53220a tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:44.556767 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-74f4d9f3-9458-44c3-9a5c-79396b53220a tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:44.557513 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-74f4d9f3-9458-44c3-9a5c-79396b53220a tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:44.558181 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-74f4d9f3-9458-44c3-9a5c-79396b53220a tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:44.671255 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-67cf8727-1635-43d9-a809-371be5112429 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139dfba82fda43f1a058c60b1a4dc818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e6fee821e7449b92c3df24de169fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:44.680907 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-67cf8727-1635-43d9-a809-371be5112429 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] 10.222.0.17 "GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f" status: 200 len: 1314 microversion: 2.1 time: 0.205369 Sep 30 19:31:44.696989 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 230/436] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:44 2022] GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:44.701855 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [req-0fe182b0-e173-4628-82c0-7fd367f71121 req-b539699d-5b12-466c-89c9-9a2f778faa10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64cf2b54-6641-405a-bc74-75509e41561f", "tag": "4684f5cf-0152-4342-b0ab-0aca5392df42"}]} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:31:44.712554 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-0fe182b0-e173-4628-82c0-7fd367f71121 req-b539699d-5b12-466c-89c9-9a2f778faa10 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:44.713036 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-0fe182b0-e173-4628-82c0-7fd367f71121 req-b539699d-5b12-466c-89c9-9a2f778faa10 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:44.713474 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-0fe182b0-e173-4628-82c0-7fd367f71121 req-b539699d-5b12-466c-89c9-9a2f778faa10 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:44.729982 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.compute.server_external_events [req-0fe182b0-e173-4628-82c0-7fd367f71121 req-b539699d-5b12-466c-89c9-9a2f778faa10 service nova] Creating event network-changed:4684f5cf-0152-4342-b0ab-0aca5392df42 for instance 64cf2b54-6641-405a-bc74-75509e41561f on hv-cinder-86001 Sep 30 19:31:44.736713 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [req-0fe182b0-e173-4628-82c0-7fd367f71121 req-b539699d-5b12-466c-89c9-9a2f778faa10 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037833 Sep 30 19:31:44.737582 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 231/437] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:31:44.837096 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-74f4d9f3-9458-44c3-9a5c-79396b53220a tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:44.847303 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-74f4d9f3-9458-44c3-9a5c-79396b53220a tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1261 microversion: 2.1 time: 0.307561 Sep 30 19:31:44.856812 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 207/438] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:44 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1261 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:31:44.989587 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-92e5d37d-5798-4373-b099-b007f70bb0e9 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:44.990545 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-92e5d37d-5798-4373-b099-b007f70bb0e9 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 5fd6c296-8008-4f27-82c0-36839a4eec3f] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:44.997608 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-92e5d37d-5798-4373-b099-b007f70bb0e9 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:44.998092 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-92e5d37d-5798-4373-b099-b007f70bb0e9 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:44.998531 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-92e5d37d-5798-4373-b099-b007f70bb0e9 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:44.999231 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-92e5d37d-5798-4373-b099-b007f70bb0e9 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:44.999681 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-92e5d37d-5798-4373-b099-b007f70bb0e9 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:45.002994 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-92e5d37d-5798-4373-b099-b007f70bb0e9 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:45.138620 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-92e5d37d-5798-4373-b099-b007f70bb0e9 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:45.153569 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-92e5d37d-5798-4373-b099-b007f70bb0e9 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f" status: 200 len: 1522 microversion: 2.1 time: 0.171770 Sep 30 19:31:45.154155 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 232/439] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:44 2022] GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:31:45.703179 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-b2b8036f-24b7-4446-ba96-c6db837f088b tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:45.703795 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-b2b8036f-24b7-4446-ba96-c6db837f088b tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 64cf2b54-6641-405a-bc74-75509e41561f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:45.710674 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b2b8036f-24b7-4446-ba96-c6db837f088b tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:45.711174 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b2b8036f-24b7-4446-ba96-c6db837f088b tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:45.711606 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b2b8036f-24b7-4446-ba96-c6db837f088b tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:45.712296 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b2b8036f-24b7-4446-ba96-c6db837f088b tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:45.712773 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b2b8036f-24b7-4446-ba96-c6db837f088b tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:45.713191 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b2b8036f-24b7-4446-ba96-c6db837f088b tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:45.873867 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-c03a3f49-e44f-4fc0-899c-f8f18acb1751 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:45.874445 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-b2b8036f-24b7-4446-ba96-c6db837f088b tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139dfba82fda43f1a058c60b1a4dc818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e6fee821e7449b92c3df24de169fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:45.875101 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-c03a3f49-e44f-4fc0-899c-f8f18acb1751 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:45.881485 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c03a3f49-e44f-4fc0-899c-f8f18acb1751 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:45.882227 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c03a3f49-e44f-4fc0-899c-f8f18acb1751 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:45.883302 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c03a3f49-e44f-4fc0-899c-f8f18acb1751 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:45.883426 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-b2b8036f-24b7-4446-ba96-c6db837f088b tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] 10.222.0.17 "GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f" status: 200 len: 1314 microversion: 2.1 time: 0.183857 Sep 30 19:31:45.884202 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 208/440] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:45 2022] GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:45.884783 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c03a3f49-e44f-4fc0-899c-f8f18acb1751 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:45.885474 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c03a3f49-e44f-4fc0-899c-f8f18acb1751 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:45.886110 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c03a3f49-e44f-4fc0-899c-f8f18acb1751 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:46.029006 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-c03a3f49-e44f-4fc0-899c-f8f18acb1751 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:46.044445 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-c03a3f49-e44f-4fc0-899c-f8f18acb1751 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1261 microversion: 2.1 time: 0.175723 Sep 30 19:31:46.045035 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 233/441] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:45 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1261 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:46.177506 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-f37e07aa-7a60-4ebf-aca8-1f295fc0cd2d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:46.178121 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-f37e07aa-7a60-4ebf-aca8-1f295fc0cd2d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 5fd6c296-8008-4f27-82c0-36839a4eec3f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:46.184029 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f37e07aa-7a60-4ebf-aca8-1f295fc0cd2d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:46.184710 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f37e07aa-7a60-4ebf-aca8-1f295fc0cd2d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:46.185311 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f37e07aa-7a60-4ebf-aca8-1f295fc0cd2d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:46.186383 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f37e07aa-7a60-4ebf-aca8-1f295fc0cd2d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:46.186845 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f37e07aa-7a60-4ebf-aca8-1f295fc0cd2d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:46.187273 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f37e07aa-7a60-4ebf-aca8-1f295fc0cd2d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:46.323077 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f37e07aa-7a60-4ebf-aca8-1f295fc0cd2d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:46.331667 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-f37e07aa-7a60-4ebf-aca8-1f295fc0cd2d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f" status: 200 len: 1522 microversion: 2.1 time: 0.157458 Sep 30 19:31:46.332729 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 209/442] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:46 2022] GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:46.909494 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-8680a4d7-b9c5-4855-866b-8ae61680255b tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:46.910104 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-8680a4d7-b9c5-4855-866b-8ae61680255b tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 64cf2b54-6641-405a-bc74-75509e41561f] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:46.912058 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell0:SELECT=2 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:31:46.912867 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell0:SELECT=6 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:31:46.919109 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8680a4d7-b9c5-4855-866b-8ae61680255b tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:46.919594 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8680a4d7-b9c5-4855-866b-8ae61680255b tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:46.920035 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8680a4d7-b9c5-4855-866b-8ae61680255b tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:46.920774 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8680a4d7-b9c5-4855-866b-8ae61680255b tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:46.921226 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8680a4d7-b9c5-4855-866b-8ae61680255b tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:46.921647 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8680a4d7-b9c5-4855-866b-8ae61680255b tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:47.067002 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-4dba711d-b405-417b-94a9-6e11f43cd97c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:47.068392 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-4dba711d-b405-417b-94a9-6e11f43cd97c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:47.071779 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-8680a4d7-b9c5-4855-866b-8ae61680255b tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139dfba82fda43f1a058c60b1a4dc818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e6fee821e7449b92c3df24de169fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:47.072895 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=2 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:31:47.078260 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4dba711d-b405-417b-94a9-6e11f43cd97c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:47.078892 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4dba711d-b405-417b-94a9-6e11f43cd97c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:47.079539 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4dba711d-b405-417b-94a9-6e11f43cd97c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:47.080469 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4dba711d-b405-417b-94a9-6e11f43cd97c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:47.081064 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-8680a4d7-b9c5-4855-866b-8ae61680255b tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] 10.222.0.17 "GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f" status: 200 len: 1314 microversion: 2.1 time: 0.175541 Sep 30 19:31:47.081838 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 234/443] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:46 2022] GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:47.082989 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4dba711d-b405-417b-94a9-6e11f43cd97c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:47.084108 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4dba711d-b405-417b-94a9-6e11f43cd97c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:47.227906 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-4dba711d-b405-417b-94a9-6e11f43cd97c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:47.238678 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-4dba711d-b405-417b-94a9-6e11f43cd97c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1261 microversion: 2.1 time: 0.175522 Sep 30 19:31:47.239364 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 210/444] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:47 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1261 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:31:47.353994 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-bb50ed1b-34c0-4df1-af3d-97d28b6351f9 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:47.354711 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-bb50ed1b-34c0-4df1-af3d-97d28b6351f9 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 5fd6c296-8008-4f27-82c0-36839a4eec3f] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:47.363484 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-bb50ed1b-34c0-4df1-af3d-97d28b6351f9 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:47.363991 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-bb50ed1b-34c0-4df1-af3d-97d28b6351f9 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:47.364448 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-bb50ed1b-34c0-4df1-af3d-97d28b6351f9 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:47.365192 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-bb50ed1b-34c0-4df1-af3d-97d28b6351f9 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:47.365651 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-bb50ed1b-34c0-4df1-af3d-97d28b6351f9 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:47.366070 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-bb50ed1b-34c0-4df1-af3d-97d28b6351f9 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:47.504341 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-bb50ed1b-34c0-4df1-af3d-97d28b6351f9 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:47.511822 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-bb50ed1b-34c0-4df1-af3d-97d28b6351f9 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f" status: 200 len: 1522 microversion: 2.1 time: 0.161889 Sep 30 19:31:47.512398 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 235/445] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:47 2022] GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:48.103271 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-1575161c-e459-4023-a987-8187029be6e6 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:48.103968 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-1575161c-e459-4023-a987-8187029be6e6 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 64cf2b54-6641-405a-bc74-75509e41561f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:48.106460 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:31:48.113052 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1575161c-e459-4023-a987-8187029be6e6 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:48.113740 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1575161c-e459-4023-a987-8187029be6e6 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:48.114247 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1575161c-e459-4023-a987-8187029be6e6 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:48.114953 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1575161c-e459-4023-a987-8187029be6e6 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:48.115413 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1575161c-e459-4023-a987-8187029be6e6 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:48.115840 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1575161c-e459-4023-a987-8187029be6e6 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:48.149259 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [req-c139f246-2bf8-4649-ab0d-127ce122b25b req-79c25951-fa9a-4513-a21d-b0449f2b0805 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4d9e349-e05e-43c7-ac04-37d75ee740ab", "name": "network-vif-plugged", "status": "completed", "tag": "b73129fe-b689-4fff-8b47-dd8833dbebb1"}]} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:31:48.155385 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:31:48.165390 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-c139f246-2bf8-4649-ab0d-127ce122b25b req-79c25951-fa9a-4513-a21d-b0449f2b0805 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:48.166132 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-c139f246-2bf8-4649-ab0d-127ce122b25b req-79c25951-fa9a-4513-a21d-b0449f2b0805 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:48.166559 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-c139f246-2bf8-4649-ab0d-127ce122b25b req-79c25951-fa9a-4513-a21d-b0449f2b0805 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:48.179915 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.compute.server_external_events [req-c139f246-2bf8-4649-ab0d-127ce122b25b req-79c25951-fa9a-4513-a21d-b0449f2b0805 service nova] Creating event network-vif-plugged:b73129fe-b689-4fff-8b47-dd8833dbebb1 for instance e4d9e349-e05e-43c7-ac04-37d75ee740ab on hv-cinder-86001 Sep 30 19:31:48.185773 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [req-c139f246-2bf8-4649-ab0d-127ce122b25b req-79c25951-fa9a-4513-a21d-b0449f2b0805 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040710 Sep 30 19:31:48.186529 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 236/446] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 30 19:31:48.259322 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-1575161c-e459-4023-a987-8187029be6e6 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139dfba82fda43f1a058c60b1a4dc818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e6fee821e7449b92c3df24de169fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:48.266055 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-be3af47b-6914-4482-a444-df1b8207d122 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:48.266765 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-be3af47b-6914-4482-a444-df1b8207d122 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:48.267531 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-1575161c-e459-4023-a987-8187029be6e6 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] 10.222.0.17 "GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f" status: 200 len: 1314 microversion: 2.1 time: 0.168254 Sep 30 19:31:48.268160 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 211/447] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:48 2022] GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:48.273156 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-be3af47b-6914-4482-a444-df1b8207d122 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:48.273647 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-be3af47b-6914-4482-a444-df1b8207d122 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:48.274089 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-be3af47b-6914-4482-a444-df1b8207d122 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:48.274814 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-be3af47b-6914-4482-a444-df1b8207d122 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:48.275280 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-be3af47b-6914-4482-a444-df1b8207d122 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:48.275747 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-be3af47b-6914-4482-a444-df1b8207d122 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:48.413691 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-be3af47b-6914-4482-a444-df1b8207d122 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:48.425634 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-be3af47b-6914-4482-a444-df1b8207d122 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1261 microversion: 2.1 time: 0.162935 Sep 30 19:31:48.426624 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 237/448] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:48 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1261 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:48.535842 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-13b39830-1a77-422e-9d40-49cbd6cdfc6c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:48.536491 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-13b39830-1a77-422e-9d40-49cbd6cdfc6c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 5fd6c296-8008-4f27-82c0-36839a4eec3f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:48.542491 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-13b39830-1a77-422e-9d40-49cbd6cdfc6c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:48.542972 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-13b39830-1a77-422e-9d40-49cbd6cdfc6c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:48.543407 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-13b39830-1a77-422e-9d40-49cbd6cdfc6c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:48.544099 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-13b39830-1a77-422e-9d40-49cbd6cdfc6c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:48.544579 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-13b39830-1a77-422e-9d40-49cbd6cdfc6c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:48.545005 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-13b39830-1a77-422e-9d40-49cbd6cdfc6c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:48.711171 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-13b39830-1a77-422e-9d40-49cbd6cdfc6c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:48.718823 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-13b39830-1a77-422e-9d40-49cbd6cdfc6c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f" status: 200 len: 1522 microversion: 2.1 time: 0.187673 Sep 30 19:31:48.719396 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 212/449] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:48 2022] GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:49.290888 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-31ebc5bb-e244-40d7-8b71-d4160d2d8c17 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:49.291484 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-31ebc5bb-e244-40d7-8b71-d4160d2d8c17 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 64cf2b54-6641-405a-bc74-75509e41561f] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:49.297498 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-31ebc5bb-e244-40d7-8b71-d4160d2d8c17 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:49.298024 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-31ebc5bb-e244-40d7-8b71-d4160d2d8c17 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:49.298460 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-31ebc5bb-e244-40d7-8b71-d4160d2d8c17 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:49.299164 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-31ebc5bb-e244-40d7-8b71-d4160d2d8c17 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:49.299623 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-31ebc5bb-e244-40d7-8b71-d4160d2d8c17 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:49.300049 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-31ebc5bb-e244-40d7-8b71-d4160d2d8c17 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:49.434100 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-31ebc5bb-e244-40d7-8b71-d4160d2d8c17 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139dfba82fda43f1a058c60b1a4dc818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e6fee821e7449b92c3df24de169fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:49.442402 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-31ebc5bb-e244-40d7-8b71-d4160d2d8c17 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] 10.222.0.17 "GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f" status: 200 len: 1314 microversion: 2.1 time: 0.155339 Sep 30 19:31:49.443006 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 238/450] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:49 2022] GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:49.448735 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-96155223-aa89-4e5b-ba3f-4ae4b96b2f6e tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:49.449586 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-96155223-aa89-4e5b-ba3f-4ae4b96b2f6e tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:49.456676 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-96155223-aa89-4e5b-ba3f-4ae4b96b2f6e tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:49.457203 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-96155223-aa89-4e5b-ba3f-4ae4b96b2f6e tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:49.457805 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-96155223-aa89-4e5b-ba3f-4ae4b96b2f6e tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:49.458520 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-96155223-aa89-4e5b-ba3f-4ae4b96b2f6e tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:49.458974 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-96155223-aa89-4e5b-ba3f-4ae4b96b2f6e tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:49.461145 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-96155223-aa89-4e5b-ba3f-4ae4b96b2f6e tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:49.629012 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-96155223-aa89-4e5b-ba3f-4ae4b96b2f6e tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:49.637011 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-96155223-aa89-4e5b-ba3f-4ae4b96b2f6e tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1261 microversion: 2.1 time: 0.192271 Sep 30 19:31:49.637573 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 213/451] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:49 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1261 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:49.742984 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-8f76c74e-aa66-4076-8883-98b7936c83b4 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:49.743664 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-8f76c74e-aa66-4076-8883-98b7936c83b4 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 5fd6c296-8008-4f27-82c0-36839a4eec3f] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:49.750277 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8f76c74e-aa66-4076-8883-98b7936c83b4 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:49.750776 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8f76c74e-aa66-4076-8883-98b7936c83b4 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:49.751214 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8f76c74e-aa66-4076-8883-98b7936c83b4 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:49.751923 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8f76c74e-aa66-4076-8883-98b7936c83b4 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:49.752390 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8f76c74e-aa66-4076-8883-98b7936c83b4 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:49.753484 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8f76c74e-aa66-4076-8883-98b7936c83b4 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:49.882047 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-8f76c74e-aa66-4076-8883-98b7936c83b4 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:49.889698 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-8f76c74e-aa66-4076-8883-98b7936c83b4 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f" status: 200 len: 1522 microversion: 2.1 time: 0.150960 Sep 30 19:31:49.890315 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 239/452] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:49 2022] GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:50.466029 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-7a78e029-1450-4799-b0ed-aeef0ca3095b tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:50.466637 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-7a78e029-1450-4799-b0ed-aeef0ca3095b tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 64cf2b54-6641-405a-bc74-75509e41561f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:50.474012 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7a78e029-1450-4799-b0ed-aeef0ca3095b tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:50.474501 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7a78e029-1450-4799-b0ed-aeef0ca3095b tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:50.474942 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7a78e029-1450-4799-b0ed-aeef0ca3095b tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:50.475637 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7a78e029-1450-4799-b0ed-aeef0ca3095b tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:50.476265 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7a78e029-1450-4799-b0ed-aeef0ca3095b tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:50.476720 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7a78e029-1450-4799-b0ed-aeef0ca3095b tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:50.617528 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-7a78e029-1450-4799-b0ed-aeef0ca3095b tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139dfba82fda43f1a058c60b1a4dc818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e6fee821e7449b92c3df24de169fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:50.625474 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-7a78e029-1450-4799-b0ed-aeef0ca3095b tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] 10.222.0.17 "GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f" status: 200 len: 1314 microversion: 2.1 time: 0.163334 Sep 30 19:31:50.626126 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 214/453] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:50 2022] GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:50.661448 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-cc4d8cae-4abf-4be6-a316-44ef2a55e39b tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:50.662243 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-cc4d8cae-4abf-4be6-a316-44ef2a55e39b tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:50.668207 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-cc4d8cae-4abf-4be6-a316-44ef2a55e39b tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:50.668730 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-cc4d8cae-4abf-4be6-a316-44ef2a55e39b tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:50.669169 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-cc4d8cae-4abf-4be6-a316-44ef2a55e39b tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:50.669871 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-cc4d8cae-4abf-4be6-a316-44ef2a55e39b tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:50.670435 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-cc4d8cae-4abf-4be6-a316-44ef2a55e39b tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:50.670865 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-cc4d8cae-4abf-4be6-a316-44ef2a55e39b tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:50.815776 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-cc4d8cae-4abf-4be6-a316-44ef2a55e39b tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:50.823603 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-cc4d8cae-4abf-4be6-a316-44ef2a55e39b tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1261 microversion: 2.1 time: 0.167045 Sep 30 19:31:50.824180 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 240/454] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:50 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1261 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:50.914698 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-6c457a0d-8e60-4777-83e1-8accae5d4664 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:50.915577 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-6c457a0d-8e60-4777-83e1-8accae5d4664 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 5fd6c296-8008-4f27-82c0-36839a4eec3f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:50.926481 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6c457a0d-8e60-4777-83e1-8accae5d4664 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:50.927198 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6c457a0d-8e60-4777-83e1-8accae5d4664 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:50.927879 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6c457a0d-8e60-4777-83e1-8accae5d4664 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:50.928721 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6c457a0d-8e60-4777-83e1-8accae5d4664 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:50.929245 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6c457a0d-8e60-4777-83e1-8accae5d4664 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:50.930262 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6c457a0d-8e60-4777-83e1-8accae5d4664 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:51.076876 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-6c457a0d-8e60-4777-83e1-8accae5d4664 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:51.085340 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-6c457a0d-8e60-4777-83e1-8accae5d4664 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f" status: 200 len: 1522 microversion: 2.1 time: 0.176564 Sep 30 19:31:51.086213 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 215/455] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:50 2022] GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:51.648434 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-78b7c069-e639-4363-8e11-81d76ffb76c6 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:51.649261 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-78b7c069-e639-4363-8e11-81d76ffb76c6 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 64cf2b54-6641-405a-bc74-75509e41561f] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:51.655193 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-78b7c069-e639-4363-8e11-81d76ffb76c6 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:51.655684 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-78b7c069-e639-4363-8e11-81d76ffb76c6 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:51.656125 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-78b7c069-e639-4363-8e11-81d76ffb76c6 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:51.656854 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-78b7c069-e639-4363-8e11-81d76ffb76c6 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:51.657315 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-78b7c069-e639-4363-8e11-81d76ffb76c6 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:51.657749 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-78b7c069-e639-4363-8e11-81d76ffb76c6 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:51.662387 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell1:SELECT=100 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:31:51.793976 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-78b7c069-e639-4363-8e11-81d76ffb76c6 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139dfba82fda43f1a058c60b1a4dc818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e6fee821e7449b92c3df24de169fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:51.803187 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-78b7c069-e639-4363-8e11-81d76ffb76c6 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] 10.222.0.17 "GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f" status: 200 len: 1314 microversion: 2.1 time: 0.158693 Sep 30 19:31:51.803946 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 241/456] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:51 2022] GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:51.851615 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-196f4713-2860-48cb-9e2e-82236ce2e703 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:51.852247 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-196f4713-2860-48cb-9e2e-82236ce2e703 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:51.859404 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-196f4713-2860-48cb-9e2e-82236ce2e703 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:51.859903 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-196f4713-2860-48cb-9e2e-82236ce2e703 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:51.860344 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-196f4713-2860-48cb-9e2e-82236ce2e703 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:51.861072 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-196f4713-2860-48cb-9e2e-82236ce2e703 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:51.861534 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-196f4713-2860-48cb-9e2e-82236ce2e703 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:51.862619 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-196f4713-2860-48cb-9e2e-82236ce2e703 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:52.003211 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-196f4713-2860-48cb-9e2e-82236ce2e703 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:52.011184 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-196f4713-2860-48cb-9e2e-82236ce2e703 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1261 microversion: 2.1 time: 0.163749 Sep 30 19:31:52.011781 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 216/457] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:51 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1261 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:52.108087 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-29619f31-f708-4b8e-9525-cebff0c56d73 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:52.108727 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-29619f31-f708-4b8e-9525-cebff0c56d73 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 5fd6c296-8008-4f27-82c0-36839a4eec3f] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:52.114926 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-29619f31-f708-4b8e-9525-cebff0c56d73 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:52.115419 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-29619f31-f708-4b8e-9525-cebff0c56d73 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:52.115862 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-29619f31-f708-4b8e-9525-cebff0c56d73 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:52.116594 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-29619f31-f708-4b8e-9525-cebff0c56d73 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:52.117052 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-29619f31-f708-4b8e-9525-cebff0c56d73 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:52.117479 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-29619f31-f708-4b8e-9525-cebff0c56d73 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:52.464696 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-29619f31-f708-4b8e-9525-cebff0c56d73 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:52.472320 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-29619f31-f708-4b8e-9525-cebff0c56d73 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f" status: 200 len: 1522 microversion: 2.1 time: 0.368109 Sep 30 19:31:52.472905 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 242/458] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:52 2022] GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f => generated 1522 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:52.741081 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-73ba3f86-e0d0-469a-9a48-56702144048d req-ade629b9-6b34-4f44-83de-f7ed752a0cfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64cf2b54-6641-405a-bc74-75509e41561f", "name": "network-vif-plugged", "status": "completed", "tag": "4684f5cf-0152-4342-b0ab-0aca5392df42"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:31:52.752337 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-73ba3f86-e0d0-469a-9a48-56702144048d req-ade629b9-6b34-4f44-83de-f7ed752a0cfb service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:52.754382 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-73ba3f86-e0d0-469a-9a48-56702144048d req-ade629b9-6b34-4f44-83de-f7ed752a0cfb service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:52.755036 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-73ba3f86-e0d0-469a-9a48-56702144048d req-ade629b9-6b34-4f44-83de-f7ed752a0cfb service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:52.759491 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=100 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:31:52.772631 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-73ba3f86-e0d0-469a-9a48-56702144048d req-ade629b9-6b34-4f44-83de-f7ed752a0cfb service nova] Creating event network-vif-plugged:4684f5cf-0152-4342-b0ab-0aca5392df42 for instance 64cf2b54-6641-405a-bc74-75509e41561f on hv-cinder-86001 Sep 30 19:31:52.778499 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-73ba3f86-e0d0-469a-9a48-56702144048d req-ade629b9-6b34-4f44-83de-f7ed752a0cfb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042865 Sep 30 19:31:52.781150 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 217/459] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:31:52.835115 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-6a54d2b8-c82a-4431-b065-96785cecf003 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:52.835661 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-6a54d2b8-c82a-4431-b065-96785cecf003 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 64cf2b54-6641-405a-bc74-75509e41561f] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:52.841541 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6a54d2b8-c82a-4431-b065-96785cecf003 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:52.842014 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6a54d2b8-c82a-4431-b065-96785cecf003 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:52.842440 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6a54d2b8-c82a-4431-b065-96785cecf003 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:52.843120 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6a54d2b8-c82a-4431-b065-96785cecf003 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:52.843564 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6a54d2b8-c82a-4431-b065-96785cecf003 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:52.843987 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6a54d2b8-c82a-4431-b065-96785cecf003 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:52.980553 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-6a54d2b8-c82a-4431-b065-96785cecf003 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139dfba82fda43f1a058c60b1a4dc818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e6fee821e7449b92c3df24de169fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:52.988616 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-6a54d2b8-c82a-4431-b065-96785cecf003 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] 10.222.0.17 "GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f" status: 200 len: 1314 microversion: 2.1 time: 0.157417 Sep 30 19:31:52.989171 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 243/460] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:52 2022] GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:53.034718 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-44884698-5b65-4d16-972a-fc3bcc3476cc tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:53.035506 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-44884698-5b65-4d16-972a-fc3bcc3476cc tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:53.041624 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-44884698-5b65-4d16-972a-fc3bcc3476cc tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:53.042109 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-44884698-5b65-4d16-972a-fc3bcc3476cc tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:53.042544 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-44884698-5b65-4d16-972a-fc3bcc3476cc tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:53.043260 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-44884698-5b65-4d16-972a-fc3bcc3476cc tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:53.043713 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-44884698-5b65-4d16-972a-fc3bcc3476cc tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:53.044137 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-44884698-5b65-4d16-972a-fc3bcc3476cc tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:53.182377 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-44884698-5b65-4d16-972a-fc3bcc3476cc tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:53.190113 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-44884698-5b65-4d16-972a-fc3bcc3476cc tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1261 microversion: 2.1 time: 0.160595 Sep 30 19:31:53.190672 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 218/461] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:53 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1261 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:31:53.496269 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-d0d1092f-c120-48db-9407-673b569ceab3 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:53.496911 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-d0d1092f-c120-48db-9407-673b569ceab3 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 5fd6c296-8008-4f27-82c0-36839a4eec3f] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:53.502889 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d0d1092f-c120-48db-9407-673b569ceab3 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:53.503371 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d0d1092f-c120-48db-9407-673b569ceab3 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:53.503811 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d0d1092f-c120-48db-9407-673b569ceab3 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:53.504566 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d0d1092f-c120-48db-9407-673b569ceab3 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:53.505073 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d0d1092f-c120-48db-9407-673b569ceab3 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:53.505535 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d0d1092f-c120-48db-9407-673b569ceab3 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:53.637312 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-d0d1092f-c120-48db-9407-673b569ceab3 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:53.646054 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-d0d1092f-c120-48db-9407-673b569ceab3 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f" status: 200 len: 1522 microversion: 2.1 time: 0.153718 Sep 30 19:31:53.646621 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 244/462] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:53 2022] GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:54.011790 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-8adbc80b-c335-4763-aa9c-f265f8ba87f5 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:54.012697 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-8adbc80b-c335-4763-aa9c-f265f8ba87f5 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 64cf2b54-6641-405a-bc74-75509e41561f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:54.021396 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8adbc80b-c335-4763-aa9c-f265f8ba87f5 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:54.021975 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8adbc80b-c335-4763-aa9c-f265f8ba87f5 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:54.022417 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8adbc80b-c335-4763-aa9c-f265f8ba87f5 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:54.023117 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8adbc80b-c335-4763-aa9c-f265f8ba87f5 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:54.023573 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8adbc80b-c335-4763-aa9c-f265f8ba87f5 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:54.023996 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8adbc80b-c335-4763-aa9c-f265f8ba87f5 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:54.176171 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-8adbc80b-c335-4763-aa9c-f265f8ba87f5 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139dfba82fda43f1a058c60b1a4dc818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e6fee821e7449b92c3df24de169fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:54.184674 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-8adbc80b-c335-4763-aa9c-f265f8ba87f5 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] 10.222.0.17 "GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f" status: 200 len: 1314 microversion: 2.1 time: 0.176780 Sep 30 19:31:54.185231 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 219/463] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:54 2022] GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:54.212414 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-15db54cf-7437-4ac3-a487-8a52403a8386 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:54.213026 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-15db54cf-7437-4ac3-a487-8a52403a8386 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:54.219170 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-15db54cf-7437-4ac3-a487-8a52403a8386 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:54.219593 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-15db54cf-7437-4ac3-a487-8a52403a8386 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:54.220032 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-15db54cf-7437-4ac3-a487-8a52403a8386 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:54.220755 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-15db54cf-7437-4ac3-a487-8a52403a8386 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:54.221237 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-15db54cf-7437-4ac3-a487-8a52403a8386 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:54.221672 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-15db54cf-7437-4ac3-a487-8a52403a8386 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:54.363969 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-15db54cf-7437-4ac3-a487-8a52403a8386 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:54.372718 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-15db54cf-7437-4ac3-a487-8a52403a8386 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1444 microversion: 2.1 time: 0.164020 Sep 30 19:31:54.386102 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 245/464] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:54 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1444 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:54.398302 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-441a9665-8e80-4705-848a-47862c5ae9c2 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:54.398926 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-441a9665-8e80-4705-848a-47862c5ae9c2 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:54.405984 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-441a9665-8e80-4705-848a-47862c5ae9c2 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:54.407379 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-441a9665-8e80-4705-848a-47862c5ae9c2 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:54.407822 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-441a9665-8e80-4705-848a-47862c5ae9c2 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:54.409526 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-441a9665-8e80-4705-848a-47862c5ae9c2 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:54.413345 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-441a9665-8e80-4705-848a-47862c5ae9c2 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:54.413802 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-441a9665-8e80-4705-848a-47862c5ae9c2 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:54.569448 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-441a9665-8e80-4705-848a-47862c5ae9c2 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:54.577420 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-441a9665-8e80-4705-848a-47862c5ae9c2 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1444 microversion: 2.1 time: 0.185400 Sep 30 19:31:54.578123 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 220/465] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:54 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1444 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:54.670042 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-9bd0d677-e385-4aa6-805a-2179df139a44 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:54.670654 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-9bd0d677-e385-4aa6-805a-2179df139a44 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 5fd6c296-8008-4f27-82c0-36839a4eec3f] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:54.676579 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9bd0d677-e385-4aa6-805a-2179df139a44 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:54.677063 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9bd0d677-e385-4aa6-805a-2179df139a44 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:54.677500 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9bd0d677-e385-4aa6-805a-2179df139a44 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:54.678194 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9bd0d677-e385-4aa6-805a-2179df139a44 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:54.678648 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9bd0d677-e385-4aa6-805a-2179df139a44 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:54.679082 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9bd0d677-e385-4aa6-805a-2179df139a44 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:54.821425 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-9bd0d677-e385-4aa6-805a-2179df139a44 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:54.829433 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-9bd0d677-e385-4aa6-805a-2179df139a44 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f" status: 200 len: 1522 microversion: 2.1 time: 0.163287 Sep 30 19:31:54.830200 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 246/466] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:54 2022] GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:55.208709 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-78e14086-4697-46e4-9734-893bd84fbea5 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:55.209342 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-78e14086-4697-46e4-9734-893bd84fbea5 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 64cf2b54-6641-405a-bc74-75509e41561f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:55.215661 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-78e14086-4697-46e4-9734-893bd84fbea5 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:55.216146 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-78e14086-4697-46e4-9734-893bd84fbea5 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:55.216625 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-78e14086-4697-46e4-9734-893bd84fbea5 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:55.217320 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-78e14086-4697-46e4-9734-893bd84fbea5 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:55.217772 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-78e14086-4697-46e4-9734-893bd84fbea5 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:55.218197 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-78e14086-4697-46e4-9734-893bd84fbea5 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:55.427267 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-78e14086-4697-46e4-9734-893bd84fbea5 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139dfba82fda43f1a058c60b1a4dc818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e6fee821e7449b92c3df24de169fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:55.436067 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-78e14086-4697-46e4-9734-893bd84fbea5 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] 10.222.0.17 "GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f" status: 200 len: 1314 microversion: 2.1 time: 0.231624 Sep 30 19:31:55.448388 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 221/467] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:55 2022] GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:55.856243 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-08fc97a8-be63-40dc-99d5-ab9babe9201d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:55.856881 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-08fc97a8-be63-40dc-99d5-ab9babe9201d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 5fd6c296-8008-4f27-82c0-36839a4eec3f] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:55.863720 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-08fc97a8-be63-40dc-99d5-ab9babe9201d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:55.864211 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-08fc97a8-be63-40dc-99d5-ab9babe9201d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:55.864681 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-08fc97a8-be63-40dc-99d5-ab9babe9201d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:55.865385 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-08fc97a8-be63-40dc-99d5-ab9babe9201d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:55.865842 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-08fc97a8-be63-40dc-99d5-ab9babe9201d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:55.866269 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-08fc97a8-be63-40dc-99d5-ab9babe9201d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:56.006307 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-08fc97a8-be63-40dc-99d5-ab9babe9201d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:56.014402 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-08fc97a8-be63-40dc-99d5-ab9babe9201d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f" status: 200 len: 1502 microversion: 2.1 time: 0.163549 Sep 30 19:31:56.015280 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 247/468] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:55 2022] GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f => generated 1502 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:56.038892 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-8fdecba3-84f7-486d-92cb-3cf78f90bb07 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e5dba212-aa90-40f9-8738-e1d8a69d72d3"}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:31:56.041319 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-8fdecba3-84f7-486d-92cb-3cf78f90bb07 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 5fd6c296-8008-4f27-82c0-36839a4eec3f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:56.051804 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8fdecba3-84f7-486d-92cb-3cf78f90bb07 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:56.052297 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8fdecba3-84f7-486d-92cb-3cf78f90bb07 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:56.052759 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8fdecba3-84f7-486d-92cb-3cf78f90bb07 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:56.053473 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8fdecba3-84f7-486d-92cb-3cf78f90bb07 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:56.053927 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8fdecba3-84f7-486d-92cb-3cf78f90bb07 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:56.054352 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8fdecba3-84f7-486d-92cb-3cf78f90bb07 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:56.079607 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.wsgi [None req-8fdecba3-84f7-486d-92cb-3cf78f90bb07 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] HTTP exception thrown: Cannot 'attach_volume' instance 5fd6c296-8008-4f27-82c0-36839a4eec3f while it is in vm_state rescued Sep 30 19:31:56.081685 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-8fdecba3-84f7-486d-92cb-3cf78f90bb07 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Request method failure captured: Sep 30 19:31:56.081685 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: request: POST /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f/os-volume_attachments HTTP/1.1 Sep 30 19:31:56.081685 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 30 19:31:56.081685 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 30 19:31:56.081685 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Connection: close Sep 30 19:31:56.081685 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Length: 74 Sep 30 19:31:56.081685 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 30 19:31:56.081685 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Host: 10.222.0.17 Sep 30 19:31:56.081685 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 30 19:31:56.081685 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 30 19:31:56.081685 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjN0OLY5VUOI52bt3J_Dc8WpYWhiT0R61qetUr3OqzHkN-xal7RFSGHLx8a-oxcImL0Kgnf7Pk8IY6K4zB9sLscM3atT-JC4PMbFzZy3-3CihN1VE_98RxWRix6-oQ90T5ltyX81-Z_CCz7FqHItP5YzDUiDTxr5fpifGluWDXW2hKMss Sep 30 19:31:56.081685 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 30 19:31:56.081685 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 30 19:31:56.081685 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 30 19:31:56.081685 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 30 19:31:56.081685 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 30 19:31:56.081685 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 30 19:31:56.081685 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Id: de44d50bb79d48189cd74cad8079e01f Sep 30 19:31:56.081685 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1953016591 Sep 30 19:31:56.081685 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 30 19:31:56.081685 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 30 19:31:56.083322 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/de44d50bb79d48189cd74cad8079e01f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/de44d50bb79d48189cd74cad8079e01f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/de44d50bb79d48189cd74cad8079e01f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_de44d50bb79d48189cd74cad8079e01f"}]}] Sep 30 19:31:56.083322 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1953016591 Sep 30 19:31:56.083322 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Id: de44d50bb79d48189cd74cad8079e01f Sep 30 19:31:56.083322 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1953016591 Sep 30 19:31:56.083322 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User: tempest-ServerRescueNegativeTestJSON-1953016591-project Sep 30 19:31:56.083322 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 30 19:31:56.083322 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 30 19:31:56.083322 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Id: 624738daa9db4aff885d71ea2d65fb26 Sep 30 19:31:56.083322 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1953016591-project Sep 30 19:31:56.083322 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Sep 30 19:31:56.083322 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: {"volumeAttachment": {"volumeId": "e5dba212-aa90-40f9-8738-e1d8a69d72d3"}} Sep 30 19:31:56.083322 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: method: > Sep 30 19:31:56.084225 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: exception: Cannot 'attach_volume' instance 5fd6c296-8008-4f27-82c0-36839a4eec3f while it is in vm_state rescued Sep 30 19:31:56.084225 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: action_args: {'server_id': '5fd6c296-8008-4f27-82c0-36839a4eec3f', 'body': {'volumeAttachment': {'volumeId': 'e5dba212-aa90-40f9-8738-e1d8a69d72d3'}}} Sep 30 19:31:56.084225 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:31:56.084225 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:31:56.084225 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 30 19:31:56.084225 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 30 19:31:56.084225 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 30 19:31:56.084225 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 30 19:31:56.084225 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 30 19:31:56.084225 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 30 19:31:56.084225 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5fd6c296-8008-4f27-82c0-36839a4eec3f in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 30 19:31:56.084225 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:31:56.084225 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:31:56.084225 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:31:56.084225 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:31:56.084225 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:31:56.084225 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:31:56.084225 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:31:56.084225 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:31:56.085704 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:31:56.085704 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:31:56.085704 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 30 19:31:56.085704 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 30 19:31:56.085704 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 30 19:31:56.085704 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 30 19:31:56.085704 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 30 19:31:56.085704 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 30 19:31:56.085704 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 30 19:31:56.085704 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 30 19:31:56.085704 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 30 19:31:56.085704 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 30 19:31:56.085704 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 5fd6c296-8008-4f27-82c0-36839a4eec3f while it is in vm_state rescued Sep 30 19:31:56.085704 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:31:56.085704 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:31:56.085704 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:31:56.085704 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:31:56.085704 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:31:56.085704 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:31:56.087064 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:31:56.087064 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:31:56.087064 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 5fd6c296-8008-4f27-82c0-36839a4eec3f while it is in vm_state rescued Sep 30 19:31:56.087064 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:31:56.087064 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-8fdecba3-84f7-486d-92cb-3cf78f90bb07 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Returning 409 to user: Cannot 'attach_volume' instance 5fd6c296-8008-4f27-82c0-36839a4eec3f while it is in vm_state rescued {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:31:56.087064 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-8fdecba3-84f7-486d-92cb-3cf78f90bb07 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "POST /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.049595 Sep 30 19:31:56.087064 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 222/469] 10.222.0.17 () {60 vars in 1323 bytes} [Fri Sep 30 19:31:56 2022] POST /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f/os-volume_attachments => generated 152 bytes in 51 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 30 19:31:56.093241 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-ed809732-d4c5-4b51-8302-c50f2d1c15c4 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:31:56.093892 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-ed809732-d4c5-4b51-8302-c50f2d1c15c4 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 5fd6c296-8008-4f27-82c0-36839a4eec3f] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:56.100597 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ed809732-d4c5-4b51-8302-c50f2d1c15c4 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:56.101112 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ed809732-d4c5-4b51-8302-c50f2d1c15c4 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:56.101599 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ed809732-d4c5-4b51-8302-c50f2d1c15c4 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:56.102496 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ed809732-d4c5-4b51-8302-c50f2d1c15c4 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:56.102951 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ed809732-d4c5-4b51-8302-c50f2d1c15c4 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:56.103377 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ed809732-d4c5-4b51-8302-c50f2d1c15c4 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:56.175482 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-ed809732-d4c5-4b51-8302-c50f2d1c15c4 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "POST /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f/action" status: 202 len: 0 microversion: 2.1 time: 0.085886 Sep 30 19:31:56.179006 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 248/470] 10.222.0.17 () {60 vars in 1278 bytes} [Fri Sep 30 19:31:56 2022] POST /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 30 19:31:56.184178 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-1f85958c-8c3e-4543-a030-ca720082c055 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:56.184809 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-1f85958c-8c3e-4543-a030-ca720082c055 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 5fd6c296-8008-4f27-82c0-36839a4eec3f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:56.190789 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1f85958c-8c3e-4543-a030-ca720082c055 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:56.191373 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1f85958c-8c3e-4543-a030-ca720082c055 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:56.191824 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1f85958c-8c3e-4543-a030-ca720082c055 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:56.192560 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1f85958c-8c3e-4543-a030-ca720082c055 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:56.193014 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1f85958c-8c3e-4543-a030-ca720082c055 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:56.193442 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1f85958c-8c3e-4543-a030-ca720082c055 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:56.463438 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-4deb1235-bba5-468b-afb5-a1cca8946fb8 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:56.464132 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-4deb1235-bba5-468b-afb5-a1cca8946fb8 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 64cf2b54-6641-405a-bc74-75509e41561f] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:56.470468 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4deb1235-bba5-468b-afb5-a1cca8946fb8 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:56.470952 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4deb1235-bba5-468b-afb5-a1cca8946fb8 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:56.472522 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4deb1235-bba5-468b-afb5-a1cca8946fb8 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:56.473231 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4deb1235-bba5-468b-afb5-a1cca8946fb8 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:56.473683 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4deb1235-bba5-468b-afb5-a1cca8946fb8 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:56.474100 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4deb1235-bba5-468b-afb5-a1cca8946fb8 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:56.645070 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-4deb1235-bba5-468b-afb5-a1cca8946fb8 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139dfba82fda43f1a058c60b1a4dc818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e6fee821e7449b92c3df24de169fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:56.646906 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-1f85958c-8c3e-4543-a030-ca720082c055 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:56.663192 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-1f85958c-8c3e-4543-a030-ca720082c055 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f" status: 200 len: 1510 microversion: 2.1 time: 0.482775 Sep 30 19:31:56.665342 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 223/471] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:56 2022] GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f => generated 1510 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:56.671082 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-4deb1235-bba5-468b-afb5-a1cca8946fb8 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] 10.222.0.17 "GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f" status: 200 len: 1314 microversion: 2.1 time: 0.211866 Sep 30 19:31:56.671803 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 249/472] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:56 2022] GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:31:56.757604 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-119acc98-f56c-4129-bb67-830487bc63ac req-6aef7f44-bf1d-4c37-aa57-f981a23d5196 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4d9e349-e05e-43c7-ac04-37d75ee740ab", "tag": "b73129fe-b689-4fff-8b47-dd8833dbebb1"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:31:56.770450 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-119acc98-f56c-4129-bb67-830487bc63ac req-6aef7f44-bf1d-4c37-aa57-f981a23d5196 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:56.771230 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-119acc98-f56c-4129-bb67-830487bc63ac req-6aef7f44-bf1d-4c37-aa57-f981a23d5196 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:56.771887 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-119acc98-f56c-4129-bb67-830487bc63ac req-6aef7f44-bf1d-4c37-aa57-f981a23d5196 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:56.788758 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-119acc98-f56c-4129-bb67-830487bc63ac req-6aef7f44-bf1d-4c37-aa57-f981a23d5196 service nova] Creating event network-changed:b73129fe-b689-4fff-8b47-dd8833dbebb1 for instance e4d9e349-e05e-43c7-ac04-37d75ee740ab on hv-cinder-86001 Sep 30 19:31:56.797528 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-119acc98-f56c-4129-bb67-830487bc63ac req-6aef7f44-bf1d-4c37-aa57-f981a23d5196 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044467 Sep 30 19:31:56.798218 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 224/473] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:31:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:31:57.687150 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-2af3378f-8853-46d5-9140-f25621a7d6ea tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:57.687869 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-2af3378f-8853-46d5-9140-f25621a7d6ea tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 5fd6c296-8008-4f27-82c0-36839a4eec3f] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:57.695178 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2af3378f-8853-46d5-9140-f25621a7d6ea tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:57.695763 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2af3378f-8853-46d5-9140-f25621a7d6ea tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:57.696065 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-2845ab9e-8959-457c-a7c7-bac066a942c8 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:57.696550 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2af3378f-8853-46d5-9140-f25621a7d6ea tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:57.697001 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2af3378f-8853-46d5-9140-f25621a7d6ea tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:57.697109 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-2845ab9e-8959-457c-a7c7-bac066a942c8 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 64cf2b54-6641-405a-bc74-75509e41561f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:57.697458 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2af3378f-8853-46d5-9140-f25621a7d6ea tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:57.697881 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2af3378f-8853-46d5-9140-f25621a7d6ea tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:57.706926 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2845ab9e-8959-457c-a7c7-bac066a942c8 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:57.707454 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2845ab9e-8959-457c-a7c7-bac066a942c8 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:57.707889 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2845ab9e-8959-457c-a7c7-bac066a942c8 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:57.708870 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2845ab9e-8959-457c-a7c7-bac066a942c8 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:57.709392 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2845ab9e-8959-457c-a7c7-bac066a942c8 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:57.710008 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2845ab9e-8959-457c-a7c7-bac066a942c8 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:57.846654 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-2af3378f-8853-46d5-9140-f25621a7d6ea tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:57.854815 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-2af3378f-8853-46d5-9140-f25621a7d6ea tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f" status: 200 len: 1510 microversion: 2.1 time: 0.171430 Sep 30 19:31:57.860443 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-2845ab9e-8959-457c-a7c7-bac066a942c8 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139dfba82fda43f1a058c60b1a4dc818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e6fee821e7449b92c3df24de169fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:57.860797 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 250/474] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:57 2022] GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f => generated 1510 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:57.867423 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-2845ab9e-8959-457c-a7c7-bac066a942c8 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] 10.222.0.17 "GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f" status: 200 len: 1314 microversion: 2.1 time: 0.176368 Sep 30 19:31:57.867992 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 225/475] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:57 2022] GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:58.878715 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-45886e5c-02d0-40e9-95de-00e57abee698 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:58.879315 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-45886e5c-02d0-40e9-95de-00e57abee698 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 5fd6c296-8008-4f27-82c0-36839a4eec3f] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:58.885249 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-45886e5c-02d0-40e9-95de-00e57abee698 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:58.885727 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-45886e5c-02d0-40e9-95de-00e57abee698 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:58.886156 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-45886e5c-02d0-40e9-95de-00e57abee698 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:58.886839 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-45886e5c-02d0-40e9-95de-00e57abee698 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:58.887287 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-45886e5c-02d0-40e9-95de-00e57abee698 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:58.887753 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-45886e5c-02d0-40e9-95de-00e57abee698 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:58.890571 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-534c0e47-d891-40c0-96ac-f054da46a1e9 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:31:58.891183 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-534c0e47-d891-40c0-96ac-f054da46a1e9 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 64cf2b54-6641-405a-bc74-75509e41561f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:31:58.898171 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-534c0e47-d891-40c0-96ac-f054da46a1e9 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:58.898688 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-534c0e47-d891-40c0-96ac-f054da46a1e9 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:58.899322 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-534c0e47-d891-40c0-96ac-f054da46a1e9 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:58.899805 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-534c0e47-d891-40c0-96ac-f054da46a1e9 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:31:58.900262 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-534c0e47-d891-40c0-96ac-f054da46a1e9 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:31:58.900722 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-534c0e47-d891-40c0-96ac-f054da46a1e9 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:31:59.025232 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-45886e5c-02d0-40e9-95de-00e57abee698 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:59.031000 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-534c0e47-d891-40c0-96ac-f054da46a1e9 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139dfba82fda43f1a058c60b1a4dc818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e6fee821e7449b92c3df24de169fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:31:59.033652 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-45886e5c-02d0-40e9-95de-00e57abee698 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f" status: 200 len: 1510 microversion: 2.1 time: 0.158794 Sep 30 19:31:59.034756 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 251/476] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:58 2022] GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:31:59.042322 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-534c0e47-d891-40c0-96ac-f054da46a1e9 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] 10.222.0.17 "GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f" status: 200 len: 1497 microversion: 2.1 time: 0.155418 Sep 30 19:31:59.042992 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 226/477] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:31:58 2022] GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:32:00.058477 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-79fd25d8-ac0e-46f0-9bda-a933d8125dd2 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:32:00.059023 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-79fd25d8-ac0e-46f0-9bda-a933d8125dd2 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 5fd6c296-8008-4f27-82c0-36839a4eec3f] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:32:00.064978 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-79fd25d8-ac0e-46f0-9bda-a933d8125dd2 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:00.065464 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-79fd25d8-ac0e-46f0-9bda-a933d8125dd2 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:00.065903 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-79fd25d8-ac0e-46f0-9bda-a933d8125dd2 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:00.066595 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-79fd25d8-ac0e-46f0-9bda-a933d8125dd2 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:00.067060 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-79fd25d8-ac0e-46f0-9bda-a933d8125dd2 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:00.067486 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-79fd25d8-ac0e-46f0-9bda-a933d8125dd2 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:00.193906 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-79fd25d8-ac0e-46f0-9bda-a933d8125dd2 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:32:00.201673 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-79fd25d8-ac0e-46f0-9bda-a933d8125dd2 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f" status: 200 len: 1510 microversion: 2.1 time: 0.147094 Sep 30 19:32:00.202237 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 252/478] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:32:00 2022] GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f => generated 1510 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:32:00.780674 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-4fdb2295-a8d7-47a4-ac91-76a35b15c531 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:32:00.781189 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-4fdb2295-a8d7-47a4-ac91-76a35b15c531 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 64cf2b54-6641-405a-bc74-75509e41561f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:32:00.787912 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4fdb2295-a8d7-47a4-ac91-76a35b15c531 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:00.788518 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4fdb2295-a8d7-47a4-ac91-76a35b15c531 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:00.789014 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4fdb2295-a8d7-47a4-ac91-76a35b15c531 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:00.789821 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4fdb2295-a8d7-47a4-ac91-76a35b15c531 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:00.790273 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4fdb2295-a8d7-47a4-ac91-76a35b15c531 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:00.790692 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4fdb2295-a8d7-47a4-ac91-76a35b15c531 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:00.814721 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-4fdb2295-a8d7-47a4-ac91-76a35b15c531 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 64cf2b54-6641-405a-bc74-75509e41561f] Going to try to terminate instance {{(pid=120648) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 30 19:32:00.886716 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-4fdb2295-a8d7-47a4-ac91-76a35b15c531 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] 10.222.0.17 "DELETE /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f" status: 204 len: 0 microversion: 2.1 time: 0.109506 Sep 30 19:32:00.887311 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 227/479] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 30 19:32:00 2022] DELETE /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 30 19:32:00.895420 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-ea009438-b32a-4ce6-9063-89dcb2e30c34 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:32:00.896024 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-ea009438-b32a-4ce6-9063-89dcb2e30c34 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 64cf2b54-6641-405a-bc74-75509e41561f] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:32:00.901914 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ea009438-b32a-4ce6-9063-89dcb2e30c34 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:00.902393 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ea009438-b32a-4ce6-9063-89dcb2e30c34 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:00.902827 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ea009438-b32a-4ce6-9063-89dcb2e30c34 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:00.903506 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ea009438-b32a-4ce6-9063-89dcb2e30c34 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:00.903952 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ea009438-b32a-4ce6-9063-89dcb2e30c34 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:00.904389 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ea009438-b32a-4ce6-9063-89dcb2e30c34 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:01.035673 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-ea009438-b32a-4ce6-9063-89dcb2e30c34 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139dfba82fda43f1a058c60b1a4dc818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e6fee821e7449b92c3df24de169fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:32:01.043356 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-ea009438-b32a-4ce6-9063-89dcb2e30c34 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] 10.222.0.17 "GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f" status: 200 len: 1503 microversion: 2.1 time: 0.151815 Sep 30 19:32:01.043911 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 253/480] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:32:00 2022] GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:32:01.226448 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-d45d2fe5-3e17-4ad4-9a88-e1e0e203ab7f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:32:01.227075 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-d45d2fe5-3e17-4ad4-9a88-e1e0e203ab7f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 5fd6c296-8008-4f27-82c0-36839a4eec3f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:32:01.232852 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d45d2fe5-3e17-4ad4-9a88-e1e0e203ab7f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:01.233328 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d45d2fe5-3e17-4ad4-9a88-e1e0e203ab7f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:01.233763 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d45d2fe5-3e17-4ad4-9a88-e1e0e203ab7f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:01.234448 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d45d2fe5-3e17-4ad4-9a88-e1e0e203ab7f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:01.234903 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d45d2fe5-3e17-4ad4-9a88-e1e0e203ab7f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:01.235327 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d45d2fe5-3e17-4ad4-9a88-e1e0e203ab7f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:01.363648 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-d45d2fe5-3e17-4ad4-9a88-e1e0e203ab7f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:32:01.371839 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-d45d2fe5-3e17-4ad4-9a88-e1e0e203ab7f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f" status: 200 len: 1510 microversion: 2.1 time: 0.150230 Sep 30 19:32:01.372355 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 228/481] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:32:01 2022] GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:32:02.067601 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-f2bd39de-4c5e-4eb5-951b-18b7db01934d tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:32:02.068133 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-f2bd39de-4c5e-4eb5-951b-18b7db01934d tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 64cf2b54-6641-405a-bc74-75509e41561f] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:32:02.073866 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f2bd39de-4c5e-4eb5-951b-18b7db01934d tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:02.074344 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f2bd39de-4c5e-4eb5-951b-18b7db01934d tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:02.074776 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f2bd39de-4c5e-4eb5-951b-18b7db01934d tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:02.075456 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f2bd39de-4c5e-4eb5-951b-18b7db01934d tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:02.075902 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f2bd39de-4c5e-4eb5-951b-18b7db01934d tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:02.076322 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f2bd39de-4c5e-4eb5-951b-18b7db01934d tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:02.202573 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-f2bd39de-4c5e-4eb5-951b-18b7db01934d tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139dfba82fda43f1a058c60b1a4dc818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e6fee821e7449b92c3df24de169fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:32:02.210711 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-f2bd39de-4c5e-4eb5-951b-18b7db01934d tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] 10.222.0.17 "GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f" status: 200 len: 1503 microversion: 2.1 time: 0.147614 Sep 30 19:32:02.211272 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 254/482] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:32:02 2022] GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f => generated 1503 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:32:02.394887 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-1c14d25b-312c-4dd8-b859-22914b1ab855 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:32:02.395483 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-1c14d25b-312c-4dd8-b859-22914b1ab855 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 5fd6c296-8008-4f27-82c0-36839a4eec3f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:32:02.401650 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1c14d25b-312c-4dd8-b859-22914b1ab855 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:02.402132 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1c14d25b-312c-4dd8-b859-22914b1ab855 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:02.402561 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1c14d25b-312c-4dd8-b859-22914b1ab855 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:02.403274 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1c14d25b-312c-4dd8-b859-22914b1ab855 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:02.403686 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1c14d25b-312c-4dd8-b859-22914b1ab855 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:02.404106 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1c14d25b-312c-4dd8-b859-22914b1ab855 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:02.533667 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-1c14d25b-312c-4dd8-b859-22914b1ab855 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:32:02.541467 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-1c14d25b-312c-4dd8-b859-22914b1ab855 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f" status: 200 len: 1510 microversion: 2.1 time: 0.150942 Sep 30 19:32:02.542032 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 229/483] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:32:02 2022] GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:32:03.234298 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-8efe8461-e606-44dd-8945-1ad1a7c405c1 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:32:03.234832 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-8efe8461-e606-44dd-8945-1ad1a7c405c1 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 64cf2b54-6641-405a-bc74-75509e41561f] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:32:03.240818 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8efe8461-e606-44dd-8945-1ad1a7c405c1 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:03.241292 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8efe8461-e606-44dd-8945-1ad1a7c405c1 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:03.241933 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8efe8461-e606-44dd-8945-1ad1a7c405c1 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:03.242613 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8efe8461-e606-44dd-8945-1ad1a7c405c1 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:03.243063 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8efe8461-e606-44dd-8945-1ad1a7c405c1 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:03.243482 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8efe8461-e606-44dd-8945-1ad1a7c405c1 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:03.372149 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-8efe8461-e606-44dd-8945-1ad1a7c405c1 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139dfba82fda43f1a058c60b1a4dc818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e6fee821e7449b92c3df24de169fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:32:03.379676 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-8efe8461-e606-44dd-8945-1ad1a7c405c1 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] 10.222.0.17 "GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f" status: 200 len: 1503 microversion: 2.1 time: 0.149529 Sep 30 19:32:03.380232 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 255/484] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:32:03 2022] GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:32:03.564902 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-20db9872-f8de-44e0-95e0-ec487844c1c2 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:32:03.566052 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-20db9872-f8de-44e0-95e0-ec487844c1c2 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 5fd6c296-8008-4f27-82c0-36839a4eec3f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:32:03.572168 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-20db9872-f8de-44e0-95e0-ec487844c1c2 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:03.572674 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-20db9872-f8de-44e0-95e0-ec487844c1c2 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:03.573108 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-20db9872-f8de-44e0-95e0-ec487844c1c2 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:03.573786 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-20db9872-f8de-44e0-95e0-ec487844c1c2 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:03.574231 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-20db9872-f8de-44e0-95e0-ec487844c1c2 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:03.574647 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-20db9872-f8de-44e0-95e0-ec487844c1c2 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:03.697732 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-20db9872-f8de-44e0-95e0-ec487844c1c2 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:32:03.705306 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-20db9872-f8de-44e0-95e0-ec487844c1c2 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f" status: 200 len: 1510 microversion: 2.1 time: 0.144382 Sep 30 19:32:03.705852 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 230/485] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:32:03 2022] GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f => generated 1510 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:32:04.402885 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-b80291d0-ca56-452c-b0cb-4c87002a551e tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:32:04.403905 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-b80291d0-ca56-452c-b0cb-4c87002a551e tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 64cf2b54-6641-405a-bc74-75509e41561f] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:32:04.410213 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b80291d0-ca56-452c-b0cb-4c87002a551e tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:04.410693 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b80291d0-ca56-452c-b0cb-4c87002a551e tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:04.411127 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b80291d0-ca56-452c-b0cb-4c87002a551e tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:04.411818 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b80291d0-ca56-452c-b0cb-4c87002a551e tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:04.412268 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b80291d0-ca56-452c-b0cb-4c87002a551e tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:04.412717 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b80291d0-ca56-452c-b0cb-4c87002a551e tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:04.538301 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-b80291d0-ca56-452c-b0cb-4c87002a551e tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139dfba82fda43f1a058c60b1a4dc818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e6fee821e7449b92c3df24de169fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:32:04.541811 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:32:04.547005 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-b80291d0-ca56-452c-b0cb-4c87002a551e tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] 10.222.0.17 "GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f" status: 200 len: 1503 microversion: 2.1 time: 0.148022 Sep 30 19:32:04.547568 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 256/486] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:32:04 2022] GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f => generated 1503 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:32:04.728801 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-072d0228-4d89-4142-8925-96ecb3adb07f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:32:04.729410 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-072d0228-4d89-4142-8925-96ecb3adb07f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 5fd6c296-8008-4f27-82c0-36839a4eec3f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:32:04.735804 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-072d0228-4d89-4142-8925-96ecb3adb07f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:04.736286 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-072d0228-4d89-4142-8925-96ecb3adb07f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:04.736757 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-072d0228-4d89-4142-8925-96ecb3adb07f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:04.737449 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-072d0228-4d89-4142-8925-96ecb3adb07f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:04.737902 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-072d0228-4d89-4142-8925-96ecb3adb07f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:04.738330 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-072d0228-4d89-4142-8925-96ecb3adb07f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:04.868315 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-072d0228-4d89-4142-8925-96ecb3adb07f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:32:04.875960 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-072d0228-4d89-4142-8925-96ecb3adb07f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f" status: 200 len: 1510 microversion: 2.1 time: 0.151077 Sep 30 19:32:04.876537 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 231/487] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:32:04 2022] GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:32:05.571076 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-2cfef2d3-c980-4ca0-9a8c-2166e51d66cc tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:32:05.571674 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-2cfef2d3-c980-4ca0-9a8c-2166e51d66cc tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 64cf2b54-6641-405a-bc74-75509e41561f] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:32:05.578779 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2cfef2d3-c980-4ca0-9a8c-2166e51d66cc tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:05.579263 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2cfef2d3-c980-4ca0-9a8c-2166e51d66cc tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:05.579694 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2cfef2d3-c980-4ca0-9a8c-2166e51d66cc tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:05.580394 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2cfef2d3-c980-4ca0-9a8c-2166e51d66cc tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:05.580849 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2cfef2d3-c980-4ca0-9a8c-2166e51d66cc tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:05.581271 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2cfef2d3-c980-4ca0-9a8c-2166e51d66cc tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:05.706898 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-2cfef2d3-c980-4ca0-9a8c-2166e51d66cc tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139dfba82fda43f1a058c60b1a4dc818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e6fee821e7449b92c3df24de169fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:32:05.714380 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-2cfef2d3-c980-4ca0-9a8c-2166e51d66cc tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] 10.222.0.17 "GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f" status: 200 len: 1503 microversion: 2.1 time: 0.147230 Sep 30 19:32:05.714935 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 257/488] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:32:05 2022] GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f => generated 1503 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:32:05.898934 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-d879e35e-7c9e-4410-8991-128649d7a1c2 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:32:05.899554 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-d879e35e-7c9e-4410-8991-128649d7a1c2 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 5fd6c296-8008-4f27-82c0-36839a4eec3f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:32:05.906088 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d879e35e-7c9e-4410-8991-128649d7a1c2 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:05.906628 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d879e35e-7c9e-4410-8991-128649d7a1c2 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:05.907028 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d879e35e-7c9e-4410-8991-128649d7a1c2 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:05.907720 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d879e35e-7c9e-4410-8991-128649d7a1c2 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:05.908291 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d879e35e-7c9e-4410-8991-128649d7a1c2 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:05.908767 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d879e35e-7c9e-4410-8991-128649d7a1c2 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:06.037940 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-d879e35e-7c9e-4410-8991-128649d7a1c2 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:32:06.045741 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-d879e35e-7c9e-4410-8991-128649d7a1c2 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f" status: 200 len: 1510 microversion: 2.1 time: 0.150651 Sep 30 19:32:06.046305 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 232/489] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:32:05 2022] GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:32:06.737740 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-cf8219d9-ed0f-4c1d-ae78-57340f4dce38 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:32:06.738370 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-cf8219d9-ed0f-4c1d-ae78-57340f4dce38 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 64cf2b54-6641-405a-bc74-75509e41561f] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:32:06.744627 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-cf8219d9-ed0f-4c1d-ae78-57340f4dce38 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:06.745103 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-cf8219d9-ed0f-4c1d-ae78-57340f4dce38 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:06.745534 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-cf8219d9-ed0f-4c1d-ae78-57340f4dce38 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:06.746209 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-cf8219d9-ed0f-4c1d-ae78-57340f4dce38 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:06.746657 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-cf8219d9-ed0f-4c1d-ae78-57340f4dce38 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:06.747076 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-cf8219d9-ed0f-4c1d-ae78-57340f4dce38 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:06.877740 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-cf8219d9-ed0f-4c1d-ae78-57340f4dce38 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139dfba82fda43f1a058c60b1a4dc818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e6fee821e7449b92c3df24de169fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:32:06.885831 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-cf8219d9-ed0f-4c1d-ae78-57340f4dce38 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] 10.222.0.17 "GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f" status: 200 len: 1503 microversion: 2.1 time: 0.152058 Sep 30 19:32:06.886389 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 258/490] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:32:06 2022] GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:32:07.070117 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-1b911827-a255-4ad7-85b2-e8dc0b6db925 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:32:07.070795 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-1b911827-a255-4ad7-85b2-e8dc0b6db925 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 5fd6c296-8008-4f27-82c0-36839a4eec3f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:32:07.076932 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1b911827-a255-4ad7-85b2-e8dc0b6db925 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:07.077418 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1b911827-a255-4ad7-85b2-e8dc0b6db925 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:07.077855 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1b911827-a255-4ad7-85b2-e8dc0b6db925 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:07.078555 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1b911827-a255-4ad7-85b2-e8dc0b6db925 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:07.079008 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1b911827-a255-4ad7-85b2-e8dc0b6db925 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:07.079434 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1b911827-a255-4ad7-85b2-e8dc0b6db925 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:07.205119 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-1b911827-a255-4ad7-85b2-e8dc0b6db925 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:32:07.208774 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:32:07.215078 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-1b911827-a255-4ad7-85b2-e8dc0b6db925 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f" status: 200 len: 1510 microversion: 2.1 time: 0.148561 Sep 30 19:32:07.215646 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 233/491] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:32:07 2022] GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:32:07.908667 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-d5737b70-74eb-40a4-984c-10cf0c73f84d tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:32:07.909509 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-d5737b70-74eb-40a4-984c-10cf0c73f84d tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 64cf2b54-6641-405a-bc74-75509e41561f] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:32:07.916070 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d5737b70-74eb-40a4-984c-10cf0c73f84d tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:07.916666 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d5737b70-74eb-40a4-984c-10cf0c73f84d tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:07.917110 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d5737b70-74eb-40a4-984c-10cf0c73f84d tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:07.917790 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d5737b70-74eb-40a4-984c-10cf0c73f84d tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:07.918241 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d5737b70-74eb-40a4-984c-10cf0c73f84d tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:07.918662 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d5737b70-74eb-40a4-984c-10cf0c73f84d tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:08.046222 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-d5737b70-74eb-40a4-984c-10cf0c73f84d tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139dfba82fda43f1a058c60b1a4dc818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e6fee821e7449b92c3df24de169fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:32:08.054357 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-d5737b70-74eb-40a4-984c-10cf0c73f84d tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] 10.222.0.17 "GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f" status: 200 len: 1503 microversion: 2.1 time: 0.149586 Sep 30 19:32:08.054913 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 259/492] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:32:07 2022] GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:32:08.239281 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-f80f1fa7-cdca-4790-a996-d62fc41a17dd tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:32:08.239813 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-f80f1fa7-cdca-4790-a996-d62fc41a17dd tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 5fd6c296-8008-4f27-82c0-36839a4eec3f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:32:08.247306 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f80f1fa7-cdca-4790-a996-d62fc41a17dd tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:08.247786 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f80f1fa7-cdca-4790-a996-d62fc41a17dd tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:08.248218 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f80f1fa7-cdca-4790-a996-d62fc41a17dd tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:08.248931 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f80f1fa7-cdca-4790-a996-d62fc41a17dd tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:08.249379 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f80f1fa7-cdca-4790-a996-d62fc41a17dd tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:08.249801 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f80f1fa7-cdca-4790-a996-d62fc41a17dd tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:08.381543 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f80f1fa7-cdca-4790-a996-d62fc41a17dd tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:32:08.389386 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-f80f1fa7-cdca-4790-a996-d62fc41a17dd tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f" status: 200 len: 1510 microversion: 2.1 time: 0.155390 Sep 30 19:32:08.389949 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 234/493] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:32:08 2022] GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:32:09.077405 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-84e3f230-b20d-40d4-a690-d8a8260c7e34 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:32:09.078013 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-84e3f230-b20d-40d4-a690-d8a8260c7e34 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 64cf2b54-6641-405a-bc74-75509e41561f] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:32:09.084350 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-84e3f230-b20d-40d4-a690-d8a8260c7e34 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:09.084865 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-84e3f230-b20d-40d4-a690-d8a8260c7e34 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:09.085304 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-84e3f230-b20d-40d4-a690-d8a8260c7e34 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:09.086001 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-84e3f230-b20d-40d4-a690-d8a8260c7e34 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:09.086459 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-84e3f230-b20d-40d4-a690-d8a8260c7e34 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:09.086900 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-84e3f230-b20d-40d4-a690-d8a8260c7e34 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:09.220923 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-84e3f230-b20d-40d4-a690-d8a8260c7e34 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139dfba82fda43f1a058c60b1a4dc818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e6fee821e7449b92c3df24de169fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:32:09.229416 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-84e3f230-b20d-40d4-a690-d8a8260c7e34 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] 10.222.0.17 "GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f" status: 200 len: 1503 microversion: 2.1 time: 0.155816 Sep 30 19:32:09.229914 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 260/494] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:32:09 2022] GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:32:09.413325 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-73fcb514-2ff7-416d-a2ec-46ac8ebcf23d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:32:09.413941 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-73fcb514-2ff7-416d-a2ec-46ac8ebcf23d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 5fd6c296-8008-4f27-82c0-36839a4eec3f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:32:09.420336 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-73fcb514-2ff7-416d-a2ec-46ac8ebcf23d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:09.420859 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-73fcb514-2ff7-416d-a2ec-46ac8ebcf23d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:09.421395 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-73fcb514-2ff7-416d-a2ec-46ac8ebcf23d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:09.422091 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-73fcb514-2ff7-416d-a2ec-46ac8ebcf23d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:09.422549 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-73fcb514-2ff7-416d-a2ec-46ac8ebcf23d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:09.422979 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-73fcb514-2ff7-416d-a2ec-46ac8ebcf23d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:09.547278 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-73fcb514-2ff7-416d-a2ec-46ac8ebcf23d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:32:09.554824 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-73fcb514-2ff7-416d-a2ec-46ac8ebcf23d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f" status: 200 len: 1510 microversion: 2.1 time: 0.146390 Sep 30 19:32:09.555395 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 235/495] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:32:09 2022] GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f => generated 1510 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:32:10.253131 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-c479add4-f9d6-4f56-9a26-b17a9a5f26b8 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:32:10.253857 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-c479add4-f9d6-4f56-9a26-b17a9a5f26b8 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 64cf2b54-6641-405a-bc74-75509e41561f] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:32:10.259728 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c479add4-f9d6-4f56-9a26-b17a9a5f26b8 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:10.260207 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c479add4-f9d6-4f56-9a26-b17a9a5f26b8 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:10.260685 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c479add4-f9d6-4f56-9a26-b17a9a5f26b8 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:10.261745 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c479add4-f9d6-4f56-9a26-b17a9a5f26b8 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:10.262234 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c479add4-f9d6-4f56-9a26-b17a9a5f26b8 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:10.262619 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c479add4-f9d6-4f56-9a26-b17a9a5f26b8 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:10.388185 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-c479add4-f9d6-4f56-9a26-b17a9a5f26b8 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139dfba82fda43f1a058c60b1a4dc818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e6fee821e7449b92c3df24de169fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:32:10.395801 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-c479add4-f9d6-4f56-9a26-b17a9a5f26b8 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] 10.222.0.17 "GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f" status: 200 len: 1503 microversion: 2.1 time: 0.147389 Sep 30 19:32:10.396381 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 261/496] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:32:10 2022] GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f => generated 1503 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:32:10.578968 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-08163e7f-c5cb-42b8-ac0c-50a109cc0a45 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:32:10.579581 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-08163e7f-c5cb-42b8-ac0c-50a109cc0a45 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 5fd6c296-8008-4f27-82c0-36839a4eec3f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:32:10.586385 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-08163e7f-c5cb-42b8-ac0c-50a109cc0a45 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:10.586866 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-08163e7f-c5cb-42b8-ac0c-50a109cc0a45 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:10.587295 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-08163e7f-c5cb-42b8-ac0c-50a109cc0a45 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:10.587978 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-08163e7f-c5cb-42b8-ac0c-50a109cc0a45 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:10.588453 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-08163e7f-c5cb-42b8-ac0c-50a109cc0a45 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:10.588879 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-08163e7f-c5cb-42b8-ac0c-50a109cc0a45 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:10.726890 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-08163e7f-c5cb-42b8-ac0c-50a109cc0a45 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:32:10.734924 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-08163e7f-c5cb-42b8-ac0c-50a109cc0a45 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f" status: 200 len: 1516 microversion: 2.1 time: 0.160430 Sep 30 19:32:10.735538 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 236/497] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:32:10 2022] GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:32:11.418481 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-23252925-f280-4489-91ce-7c90834e2716 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:32:11.419090 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-23252925-f280-4489-91ce-7c90834e2716 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 64cf2b54-6641-405a-bc74-75509e41561f] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:32:11.424958 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-23252925-f280-4489-91ce-7c90834e2716 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:11.425441 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-23252925-f280-4489-91ce-7c90834e2716 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:11.426393 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-23252925-f280-4489-91ce-7c90834e2716 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:11.427079 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-23252925-f280-4489-91ce-7c90834e2716 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:11.427561 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-23252925-f280-4489-91ce-7c90834e2716 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:11.428036 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-23252925-f280-4489-91ce-7c90834e2716 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:11.557459 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-23252925-f280-4489-91ce-7c90834e2716 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139dfba82fda43f1a058c60b1a4dc818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e6fee821e7449b92c3df24de169fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:32:11.565055 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-23252925-f280-4489-91ce-7c90834e2716 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] 10.222.0.17 "GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f" status: 200 len: 1503 microversion: 2.1 time: 0.150434 Sep 30 19:32:11.565621 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 262/498] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:32:11 2022] GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:32:12.351118 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-225bd285-0e4c-477a-927c-3598998e935d req-25048e1a-7ede-4007-a6c8-9ab1198c8062 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64cf2b54-6641-405a-bc74-75509e41561f", "name": "network-vif-deleted", "tag": "4684f5cf-0152-4342-b0ab-0aca5392df42"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:32:12.361918 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-225bd285-0e4c-477a-927c-3598998e935d req-25048e1a-7ede-4007-a6c8-9ab1198c8062 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:12.362390 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-225bd285-0e4c-477a-927c-3598998e935d req-25048e1a-7ede-4007-a6c8-9ab1198c8062 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:12.362812 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-225bd285-0e4c-477a-927c-3598998e935d req-25048e1a-7ede-4007-a6c8-9ab1198c8062 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:12.375241 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-225bd285-0e4c-477a-927c-3598998e935d req-25048e1a-7ede-4007-a6c8-9ab1198c8062 service nova] Creating event network-vif-deleted:4684f5cf-0152-4342-b0ab-0aca5392df42 for instance 64cf2b54-6641-405a-bc74-75509e41561f on hv-cinder-86001 Sep 30 19:32:12.380997 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-225bd285-0e4c-477a-927c-3598998e935d req-25048e1a-7ede-4007-a6c8-9ab1198c8062 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033546 Sep 30 19:32:12.381953 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 237/499] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:32:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:32:12.589098 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-0d9191da-b80a-46b0-82d4-69d231b86c04 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:32:12.589671 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-0d9191da-b80a-46b0-82d4-69d231b86c04 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 64cf2b54-6641-405a-bc74-75509e41561f] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:32:12.595567 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0d9191da-b80a-46b0-82d4-69d231b86c04 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:12.596052 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0d9191da-b80a-46b0-82d4-69d231b86c04 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:12.596519 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0d9191da-b80a-46b0-82d4-69d231b86c04 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:12.597225 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0d9191da-b80a-46b0-82d4-69d231b86c04 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:12.598223 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0d9191da-b80a-46b0-82d4-69d231b86c04 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:12.598651 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0d9191da-b80a-46b0-82d4-69d231b86c04 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:12.628464 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0d9191da-b80a-46b0-82d4-69d231b86c04 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:12.628967 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0d9191da-b80a-46b0-82d4-69d231b86c04 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:12.629404 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0d9191da-b80a-46b0-82d4-69d231b86c04 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:12.629848 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.objects.instance [None req-0d9191da-b80a-46b0-82d4-69d231b86c04 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lazy-loading 'fault' on Instance uuid 64cf2b54-6641-405a-bc74-75509e41561f {{(pid=120649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 30 19:32:12.670989 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-0d9191da-b80a-46b0-82d4-69d231b86c04 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139dfba82fda43f1a058c60b1a4dc818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e6fee821e7449b92c3df24de169fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:32:12.679220 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-0d9191da-b80a-46b0-82d4-69d231b86c04 tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] 10.222.0.17 "GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f" status: 200 len: 1304 microversion: 2.1 time: 0.094910 Sep 30 19:32:12.679784 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 263/500] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:32:12 2022] GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:32:13.137638 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-647ddf16-7e2e-4d33-a701-675ff85fb547 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Action: 'create', calling method: .version_select at 0x7f621efadee0>, body: {"keypair": {"name": "tempest-keypair-2027476012", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMwjdom7GojDhO6rMdxVoGbjNdFJgz+2TQFt7GnzMx6xA96v1+wmTY4zg68tcCp2Xl5AbMBCIilbrEUFi/Z4+NQsgXclmZ2jCkgCSRYbCzHGirD9YAq3EUB6iKmzw9UXA=="}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:32:13.153359 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-647ddf16-7e2e-4d33-a701-675ff85fb547 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Getting quotas for project de44d50bb79d48189cd74cad8079e01f. Resources: {'key_pairs'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 30 19:32:13.157070 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-647ddf16-7e2e-4d33-a701-675ff85fb547 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Getting quotas for user 624738daa9db4aff885d71ea2d65fb26 and project de44d50bb79d48189cd74cad8079e01f. Resources: {'key_pairs'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 30 19:32:13.180289 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-647ddf16-7e2e-4d33-a701-675ff85fb547 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046600 Sep 30 19:32:13.180911 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 238/501] 10.222.0.17 () {60 vars in 1159 bytes} [Fri Sep 30 19:32:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:32:13.702129 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-cafc26fc-889e-405a-b9f3-ea3fc691e2cb tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:32:13.702855 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-cafc26fc-889e-405a-b9f3-ea3fc691e2cb tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] [instance: 64cf2b54-6641-405a-bc74-75509e41561f] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:32:13.708984 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-cafc26fc-889e-405a-b9f3-ea3fc691e2cb tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:13.709634 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-cafc26fc-889e-405a-b9f3-ea3fc691e2cb tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:13.710356 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-cafc26fc-889e-405a-b9f3-ea3fc691e2cb tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:13.711104 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-cafc26fc-889e-405a-b9f3-ea3fc691e2cb tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:13.711803 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-cafc26fc-889e-405a-b9f3-ea3fc691e2cb tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:13.712292 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-cafc26fc-889e-405a-b9f3-ea3fc691e2cb tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:13.726623 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.wsgi [None req-cafc26fc-889e-405a-b9f3-ea3fc691e2cb tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] HTTP exception thrown: Instance 64cf2b54-6641-405a-bc74-75509e41561f could not be found. Sep 30 19:32:13.728411 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-cafc26fc-889e-405a-b9f3-ea3fc691e2cb tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Request method failure captured: Sep 30 19:32:13.728411 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: request: GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f HTTP/1.1 Sep 30 19:32:13.728411 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Accept: application/json Sep 30 19:32:13.728411 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Accept-Encoding: identity Sep 30 19:32:13.728411 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Connection: close Sep 30 19:32:13.728411 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Content-Length: 0 Sep 30 19:32:13.728411 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Content-Type: application/json Sep 30 19:32:13.728411 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Host: 10.222.0.17 Sep 30 19:32:13.728411 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Openstack-System-Scope: None Sep 30 19:32:13.728411 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: User-Agent: python-urllib3/1.26.12 Sep 30 19:32:13.728411 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Auth-Token: gAAAAABjN0P0rLmu0GeW5j6peKmJZmUwspd61G1WGW9dbru0_IhYSyJSItBZm00r7YnPSnSBzHOxekp9DvtuPx8df8BItrGTQ2XiRkH14Tt16v5dvyKLHsXmg3V2g7IF-lFJpyF2LlCEI5Aqc87sTW8OtcADZPcmrHBtshiZmhNlu39mjKCNSyI Sep 30 19:32:13.728411 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Domain-Id: None Sep 30 19:32:13.728411 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Domain-Name: None Sep 30 19:32:13.728411 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Identity-Status: Confirmed Sep 30 19:32:13.728411 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Is-Admin-Project: True Sep 30 19:32:13.728411 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Domain-Id: default Sep 30 19:32:13.728411 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Domain-Name: Default Sep 30 19:32:13.728411 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Id: 08e6fee821e7449b92c3df24de169fbc Sep 30 19:32:13.728411 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Name: tempest-VolumesActionsTest-1544322723 Sep 30 19:32:13.728411 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Role: member,reader Sep 30 19:32:13.728411 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Roles: member,reader Sep 30 19:32:13.729895 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/08e6fee821e7449b92c3df24de169fbc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/08e6fee821e7449b92c3df24de169fbc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/08e6fee821e7449b92c3df24de169fbc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_08e6fee821e7449b92c3df24de169fbc"}]}] Sep 30 19:32:13.729895 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant: tempest-VolumesActionsTest-1544322723 Sep 30 19:32:13.729895 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant-Id: 08e6fee821e7449b92c3df24de169fbc Sep 30 19:32:13.729895 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant-Name: tempest-VolumesActionsTest-1544322723 Sep 30 19:32:13.729895 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User: tempest-VolumesActionsTest-1544322723-project Sep 30 19:32:13.729895 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Domain-Id: default Sep 30 19:32:13.729895 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Domain-Name: Default Sep 30 19:32:13.729895 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Id: 139dfba82fda43f1a058c60b1a4dc818 Sep 30 19:32:13.729895 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Name: tempest-VolumesActionsTest-1544322723-project Sep 30 19:32:13.729895 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: method: > Sep 30 19:32:13.729895 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: exception: Instance 64cf2b54-6641-405a-bc74-75509e41561f could not be found. Sep 30 19:32:13.729895 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: action_args: {'id': '64cf2b54-6641-405a-bc74-75509e41561f'} Sep 30 19:32:13.730672 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:32:13.730672 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:32:13.730672 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 30 19:32:13.730672 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 30 19:32:13.730672 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 30 19:32:13.730672 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 30 19:32:13.730672 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 30 19:32:13.730672 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 30 19:32:13.730672 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 30 19:32:13.730672 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 30 19:32:13.730672 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64cf2b54-6641-405a-bc74-75509e41561f could not be found. Sep 30 19:32:13.730672 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:32:13.730672 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:32:13.730672 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:32:13.730672 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:32:13.730672 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:32:13.730672 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:32:13.730672 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:32:13.730672 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:32:13.730672 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:32:13.732058 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:32:13.732058 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 30 19:32:13.732058 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 30 19:32:13.732058 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 30 19:32:13.732058 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 30 19:32:13.732058 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 30 19:32:13.732058 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 30 19:32:13.732058 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64cf2b54-6641-405a-bc74-75509e41561f could not be found. Sep 30 19:32:13.732058 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:32:13.732058 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:32:13.732058 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:32:13.732058 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:32:13.732058 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:32:13.732058 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:32:13.732058 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:32:13.732058 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:32:13.732058 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64cf2b54-6641-405a-bc74-75509e41561f could not be found. Sep 30 19:32:13.732058 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:32:13.733221 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-cafc26fc-889e-405a-b9f3-ea3fc691e2cb tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] Returning 404 to user: Instance 64cf2b54-6641-405a-bc74-75509e41561f could not be found. {{(pid=120649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:32:13.733221 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-cafc26fc-889e-405a-b9f3-ea3fc691e2cb tempest-VolumesActionsTest-1544322723 tempest-VolumesActionsTest-1544322723-project] 10.222.0.17 "GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f" status: 404 len: 111 microversion: 2.1 time: 0.031528 Sep 30 19:32:13.733221 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 264/502] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:32:13 2022] GET /compute/v2.1/servers/64cf2b54-6641-405a-bc74-75509e41561f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 30 19:32:14.652452 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-03512731-bb52-4ace-be71-ec54d808ab2e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-236506681", "imageRef": "7714d055-7d2c-4f56-9b14-45324361e286", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bf663f3e-a66c-4db9-b314-d432454a6e93"}], "security_groups": [{"name": "tempest-securitygroup--152552135"}], "key_name": "tempest-keypair-2027476012", "user_data": "}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:32:14.758212 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.network.neutron [None req-03512731-bb52-4ace-be71-ec54d808ab2e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] validate_networks() for [('bf663f3e-a66c-4db9-b314-d432454a6e93', None, None, None, None, None)] {{(pid=120648) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 30 19:32:15.127726 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-03512731-bb52-4ace-be71-ec54d808ab2e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Flavor limits 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 30 19:32:15.128149 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-03512731-bb52-4ace-be71-ec54d808ab2e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Image limits 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 30 19:32:15.128652 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-03512731-bb52-4ace-be71-ec54d808ab2e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Flavor pref 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 30 19:32:15.129650 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-03512731-bb52-4ace-be71-ec54d808ab2e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Image pref 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 30 19:32:15.130070 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-03512731-bb52-4ace-be71-ec54d808ab2e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 30 19:32:15.138609 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-03512731-bb52-4ace-be71-ec54d808ab2e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:15.139086 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-03512731-bb52-4ace-be71-ec54d808ab2e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:15.139510 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-03512731-bb52-4ace-be71-ec54d808ab2e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:15.140241 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-03512731-bb52-4ace-be71-ec54d808ab2e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:15.140723 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-03512731-bb52-4ace-be71-ec54d808ab2e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:15.141150 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-03512731-bb52-4ace-be71-ec54d808ab2e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:15.157732 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-03512731-bb52-4ace-be71-ec54d808ab2e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Getting quotas for project de44d50bb79d48189cd74cad8079e01f. Resources: {'instances', 'ram', 'cores'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 30 19:32:15.161969 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-03512731-bb52-4ace-be71-ec54d808ab2e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Getting quotas for user 624738daa9db4aff885d71ea2d65fb26 and project de44d50bb79d48189cd74cad8079e01f. Resources: {'instances', 'ram', 'cores'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 30 19:32:15.172934 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-03512731-bb52-4ace-be71-ec54d808ab2e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Going to run 1 instances... {{(pid=120648) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 30 19:32:15.175245 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-03512731-bb52-4ace-be71-ec54d808ab2e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7714d055-7d2c-4f56-9b14-45324361e286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 30 19:32:15.221867 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-03512731-bb52-4ace-be71-ec54d808ab2e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.575927 Sep 30 19:32:15.222507 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 239/503] 10.222.0.17 () {60 vars in 1147 bytes} [Fri Sep 30 19:32:14 2022] POST /compute/v2.1/servers => generated 408 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 30 19:32:15.233637 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-b9b7792c-ff64-4ba9-811c-83d67e0b2ef4 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:32:15.234327 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-b9b7792c-ff64-4ba9-811c-83d67e0b2ef4 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:32:15.290692 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-b9b7792c-ff64-4ba9-811c-83d67e0b2ef4 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:32:15.297566 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-b9b7792c-ff64-4ba9-811c-83d67e0b2ef4 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715" status: 200 len: 1245 microversion: 2.1 time: 0.067811 Sep 30 19:32:15.298107 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 265/504] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:32:15 2022] GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715 => generated 1245 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:32:16.320596 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-a6dc58c0-97a2-4c2d-a93f-4585fa89d6af tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:32:16.321459 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-a6dc58c0-97a2-4c2d-a93f-4585fa89d6af tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:32:16.328319 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a6dc58c0-97a2-4c2d-a93f-4585fa89d6af tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:16.328830 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a6dc58c0-97a2-4c2d-a93f-4585fa89d6af tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:16.329269 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a6dc58c0-97a2-4c2d-a93f-4585fa89d6af tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:16.329959 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a6dc58c0-97a2-4c2d-a93f-4585fa89d6af tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:16.330412 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a6dc58c0-97a2-4c2d-a93f-4585fa89d6af tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:16.330840 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a6dc58c0-97a2-4c2d-a93f-4585fa89d6af tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:16.390744 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-a6dc58c0-97a2-4c2d-a93f-4585fa89d6af tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:32:16.398374 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-a6dc58c0-97a2-4c2d-a93f-4585fa89d6af tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715" status: 200 len: 1297 microversion: 2.1 time: 0.082209 Sep 30 19:32:16.398968 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 240/505] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:32:16 2022] GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715 => generated 1297 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:32:17.421722 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-0245875b-83ae-4848-adc9-d7c18e6a7b7e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:32:17.422334 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-0245875b-83ae-4848-adc9-d7c18e6a7b7e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:32:17.428716 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0245875b-83ae-4848-adc9-d7c18e6a7b7e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:17.429179 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0245875b-83ae-4848-adc9-d7c18e6a7b7e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:17.429609 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0245875b-83ae-4848-adc9-d7c18e6a7b7e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:17.430292 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0245875b-83ae-4848-adc9-d7c18e6a7b7e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:17.430740 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0245875b-83ae-4848-adc9-d7c18e6a7b7e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:17.431166 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0245875b-83ae-4848-adc9-d7c18e6a7b7e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:17.490576 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-0245875b-83ae-4848-adc9-d7c18e6a7b7e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:32:17.498093 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-0245875b-83ae-4848-adc9-d7c18e6a7b7e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715" status: 200 len: 1297 microversion: 2.1 time: 0.080291 Sep 30 19:32:17.498635 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 266/506] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:32:17 2022] GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715 => generated 1297 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:32:18.521057 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-f7e92ee5-4ee3-4525-80ad-3025846fe9b5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:32:18.521586 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-f7e92ee5-4ee3-4525-80ad-3025846fe9b5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:32:18.523994 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:32:18.529170 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f7e92ee5-4ee3-4525-80ad-3025846fe9b5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:18.529644 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f7e92ee5-4ee3-4525-80ad-3025846fe9b5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:18.530072 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f7e92ee5-4ee3-4525-80ad-3025846fe9b5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:18.530750 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f7e92ee5-4ee3-4525-80ad-3025846fe9b5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:18.531200 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f7e92ee5-4ee3-4525-80ad-3025846fe9b5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:18.531622 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f7e92ee5-4ee3-4525-80ad-3025846fe9b5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:18.596960 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f7e92ee5-4ee3-4525-80ad-3025846fe9b5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:32:18.604937 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-f7e92ee5-4ee3-4525-80ad-3025846fe9b5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715" status: 200 len: 1297 microversion: 2.1 time: 0.087783 Sep 30 19:32:18.605488 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 241/507] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:32:18 2022] GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715 => generated 1297 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:32:19.627904 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-bb7b1f75-4c36-442d-9158-657c7766ab3e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:32:19.628462 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-bb7b1f75-4c36-442d-9158-657c7766ab3e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:32:19.631023 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_api:SELECT=66 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:32:19.636129 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-bb7b1f75-4c36-442d-9158-657c7766ab3e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:19.636646 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-bb7b1f75-4c36-442d-9158-657c7766ab3e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:19.637079 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-bb7b1f75-4c36-442d-9158-657c7766ab3e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:19.637767 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-bb7b1f75-4c36-442d-9158-657c7766ab3e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:19.638217 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-bb7b1f75-4c36-442d-9158-657c7766ab3e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:19.638636 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-bb7b1f75-4c36-442d-9158-657c7766ab3e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:19.701167 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-bb7b1f75-4c36-442d-9158-657c7766ab3e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:32:19.708742 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-bb7b1f75-4c36-442d-9158-657c7766ab3e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715" status: 200 len: 1297 microversion: 2.1 time: 0.084662 Sep 30 19:32:19.709302 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 267/508] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:32:19 2022] GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715 => generated 1297 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:32:20.730733 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-6060e003-48ba-44c3-ab16-a7f65b2c4fae tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:32:20.731345 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-6060e003-48ba-44c3-ab16-a7f65b2c4fae tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:32:20.737674 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6060e003-48ba-44c3-ab16-a7f65b2c4fae tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:20.740129 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6060e003-48ba-44c3-ab16-a7f65b2c4fae tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:20.740129 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6060e003-48ba-44c3-ab16-a7f65b2c4fae tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:20.740129 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6060e003-48ba-44c3-ab16-a7f65b2c4fae tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:20.740515 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6060e003-48ba-44c3-ab16-a7f65b2c4fae tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:20.740929 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6060e003-48ba-44c3-ab16-a7f65b2c4fae tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:20.800536 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-6060e003-48ba-44c3-ab16-a7f65b2c4fae tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:32:20.808641 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-6060e003-48ba-44c3-ab16-a7f65b2c4fae tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715" status: 200 len: 1297 microversion: 2.1 time: 0.081698 Sep 30 19:32:20.809205 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 242/509] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:32:20 2022] GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715 => generated 1297 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:32:21.832160 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-c1af8801-76ed-4e83-9c74-dae4a4293a72 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:32:21.833428 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-c1af8801-76ed-4e83-9c74-dae4a4293a72 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:32:21.841627 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c1af8801-76ed-4e83-9c74-dae4a4293a72 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:21.842393 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c1af8801-76ed-4e83-9c74-dae4a4293a72 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:21.842934 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c1af8801-76ed-4e83-9c74-dae4a4293a72 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:21.843813 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c1af8801-76ed-4e83-9c74-dae4a4293a72 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:21.844559 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c1af8801-76ed-4e83-9c74-dae4a4293a72 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:21.845092 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c1af8801-76ed-4e83-9c74-dae4a4293a72 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:22.006396 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-c1af8801-76ed-4e83-9c74-dae4a4293a72 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:32:22.021805 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-c1af8801-76ed-4e83-9c74-dae4a4293a72 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715" status: 200 len: 1370 microversion: 2.1 time: 0.193387 Sep 30 19:32:22.023148 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 268/510] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:32:21 2022] GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715 => generated 1370 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:32:22.589973 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-0a8eb686-6521-47f5-8ce8-af54b3d1c916 req-12d6fc5a-1e1c-4a8c-ba90-48eb48e77e77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99020333-8572-4b29-bfa8-d5961bcde715", "tag": "21fca32a-5249-4344-9c8b-48685af3e0a7"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:32:22.604420 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-0a8eb686-6521-47f5-8ce8-af54b3d1c916 req-12d6fc5a-1e1c-4a8c-ba90-48eb48e77e77 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:22.605292 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-0a8eb686-6521-47f5-8ce8-af54b3d1c916 req-12d6fc5a-1e1c-4a8c-ba90-48eb48e77e77 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:22.605880 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-0a8eb686-6521-47f5-8ce8-af54b3d1c916 req-12d6fc5a-1e1c-4a8c-ba90-48eb48e77e77 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:22.622830 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-0a8eb686-6521-47f5-8ce8-af54b3d1c916 req-12d6fc5a-1e1c-4a8c-ba90-48eb48e77e77 service nova] Creating event network-changed:21fca32a-5249-4344-9c8b-48685af3e0a7 for instance 99020333-8572-4b29-bfa8-d5961bcde715 on hv-cinder-86001 Sep 30 19:32:22.630414 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-0a8eb686-6521-47f5-8ce8-af54b3d1c916 req-12d6fc5a-1e1c-4a8c-ba90-48eb48e77e77 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045979 Sep 30 19:32:22.631449 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 243/511] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:32:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:32:23.051158 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-8863d3d5-e8ae-4910-a175-2b0d64e61088 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:32:23.053060 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-8863d3d5-e8ae-4910-a175-2b0d64e61088 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:32:23.060541 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8863d3d5-e8ae-4910-a175-2b0d64e61088 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:23.061965 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8863d3d5-e8ae-4910-a175-2b0d64e61088 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:23.062584 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8863d3d5-e8ae-4910-a175-2b0d64e61088 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:23.063482 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8863d3d5-e8ae-4910-a175-2b0d64e61088 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:23.064781 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8863d3d5-e8ae-4910-a175-2b0d64e61088 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:23.065399 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8863d3d5-e8ae-4910-a175-2b0d64e61088 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:23.234087 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-8863d3d5-e8ae-4910-a175-2b0d64e61088 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:32:23.243455 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-8863d3d5-e8ae-4910-a175-2b0d64e61088 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715" status: 200 len: 1370 microversion: 2.1 time: 0.198094 Sep 30 19:32:23.243955 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 269/512] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:32:23 2022] GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715 => generated 1370 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:32:24.272698 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-42422acb-010b-47f5-889b-32f0e35eb207 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:32:24.275065 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-42422acb-010b-47f5-889b-32f0e35eb207 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:32:24.282919 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-42422acb-010b-47f5-889b-32f0e35eb207 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:24.283403 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-42422acb-010b-47f5-889b-32f0e35eb207 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:24.283835 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-42422acb-010b-47f5-889b-32f0e35eb207 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:24.284869 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-42422acb-010b-47f5-889b-32f0e35eb207 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:24.285684 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-42422acb-010b-47f5-889b-32f0e35eb207 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:24.286434 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-42422acb-010b-47f5-889b-32f0e35eb207 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:24.689953 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-42422acb-010b-47f5-889b-32f0e35eb207 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:32:24.699339 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-42422acb-010b-47f5-889b-32f0e35eb207 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715" status: 200 len: 1370 microversion: 2.1 time: 0.436924 Sep 30 19:32:24.716755 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 244/513] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:32:24 2022] GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715 => generated 1370 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:32:25.724320 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-f689ab70-6bab-479d-a422-ec679b4bd6f0 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:32:25.725158 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-f689ab70-6bab-479d-a422-ec679b4bd6f0 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:32:25.728355 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell0:SELECT=2 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:32:25.732850 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f689ab70-6bab-479d-a422-ec679b4bd6f0 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:25.733651 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f689ab70-6bab-479d-a422-ec679b4bd6f0 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:25.734330 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f689ab70-6bab-479d-a422-ec679b4bd6f0 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:25.735048 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f689ab70-6bab-479d-a422-ec679b4bd6f0 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:25.735505 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f689ab70-6bab-479d-a422-ec679b4bd6f0 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:25.735927 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f689ab70-6bab-479d-a422-ec679b4bd6f0 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:25.907217 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-f689ab70-6bab-479d-a422-ec679b4bd6f0 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:32:25.916494 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-f689ab70-6bab-479d-a422-ec679b4bd6f0 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715" status: 200 len: 1370 microversion: 2.1 time: 0.196718 Sep 30 19:32:25.917370 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 270/514] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:32:25 2022] GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715 => generated 1370 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:32:26.939122 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-01c1e3da-2a63-45d4-aa76-9e572008cbb8 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:32:26.939733 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-01c1e3da-2a63-45d4-aa76-9e572008cbb8 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:32:26.942584 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=2 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:32:26.943251 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=10 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:32:26.949778 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-01c1e3da-2a63-45d4-aa76-9e572008cbb8 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:26.950264 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-01c1e3da-2a63-45d4-aa76-9e572008cbb8 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:26.950861 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-01c1e3da-2a63-45d4-aa76-9e572008cbb8 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:26.951594 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-01c1e3da-2a63-45d4-aa76-9e572008cbb8 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:26.952048 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-01c1e3da-2a63-45d4-aa76-9e572008cbb8 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:26.952515 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-01c1e3da-2a63-45d4-aa76-9e572008cbb8 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:27.094612 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-01c1e3da-2a63-45d4-aa76-9e572008cbb8 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:32:27.106199 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-01c1e3da-2a63-45d4-aa76-9e572008cbb8 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715" status: 200 len: 1370 microversion: 2.1 time: 0.170704 Sep 30 19:32:27.107462 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 245/515] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:32:26 2022] GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715 => generated 1370 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:32:28.135241 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-d99b9b25-8acb-474f-a37c-e802e25e5c19 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:32:28.135935 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-d99b9b25-8acb-474f-a37c-e802e25e5c19 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:32:28.142074 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d99b9b25-8acb-474f-a37c-e802e25e5c19 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:28.142579 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d99b9b25-8acb-474f-a37c-e802e25e5c19 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:28.142996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d99b9b25-8acb-474f-a37c-e802e25e5c19 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:28.143731 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d99b9b25-8acb-474f-a37c-e802e25e5c19 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:28.144181 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d99b9b25-8acb-474f-a37c-e802e25e5c19 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:28.144657 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d99b9b25-8acb-474f-a37c-e802e25e5c19 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:28.308209 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-d99b9b25-8acb-474f-a37c-e802e25e5c19 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:32:28.318483 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-d99b9b25-8acb-474f-a37c-e802e25e5c19 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715" status: 200 len: 1370 microversion: 2.1 time: 0.186553 Sep 30 19:32:28.320020 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 271/516] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:32:28 2022] GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715 => generated 1370 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:32:29.341549 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-72f88f83-eb70-4532-b3dc-801462941790 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:32:29.342930 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-72f88f83-eb70-4532-b3dc-801462941790 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:32:29.350499 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-72f88f83-eb70-4532-b3dc-801462941790 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:29.351193 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-72f88f83-eb70-4532-b3dc-801462941790 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:29.351625 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-72f88f83-eb70-4532-b3dc-801462941790 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:29.352319 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-72f88f83-eb70-4532-b3dc-801462941790 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:29.352792 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-72f88f83-eb70-4532-b3dc-801462941790 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:29.353208 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-72f88f83-eb70-4532-b3dc-801462941790 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:29.492908 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-72f88f83-eb70-4532-b3dc-801462941790 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:32:29.501632 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-72f88f83-eb70-4532-b3dc-801462941790 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715" status: 200 len: 1370 microversion: 2.1 time: 0.164025 Sep 30 19:32:29.502156 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 246/517] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:32:29 2022] GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715 => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:32:30.524487 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-4708a0ce-dcc5-475a-b283-78b8450d3498 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:32:30.525386 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-4708a0ce-dcc5-475a-b283-78b8450d3498 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:32:30.531400 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4708a0ce-dcc5-475a-b283-78b8450d3498 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:30.532250 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4708a0ce-dcc5-475a-b283-78b8450d3498 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:30.532845 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4708a0ce-dcc5-475a-b283-78b8450d3498 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:30.533771 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4708a0ce-dcc5-475a-b283-78b8450d3498 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:30.534678 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4708a0ce-dcc5-475a-b283-78b8450d3498 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:30.535244 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4708a0ce-dcc5-475a-b283-78b8450d3498 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:30.675500 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-4708a0ce-dcc5-475a-b283-78b8450d3498 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:32:30.683698 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-4708a0ce-dcc5-475a-b283-78b8450d3498 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715" status: 200 len: 1370 microversion: 2.1 time: 0.163143 Sep 30 19:32:30.684551 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 272/518] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:32:30 2022] GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715 => generated 1370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:32:31.710685 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-09a5ab1c-5173-45df-ac74-e5d691348b2f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:32:31.711832 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-09a5ab1c-5173-45df-ac74-e5d691348b2f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:32:31.719563 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-09a5ab1c-5173-45df-ac74-e5d691348b2f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:31.720648 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-09a5ab1c-5173-45df-ac74-e5d691348b2f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:31.721210 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-09a5ab1c-5173-45df-ac74-e5d691348b2f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:31.722044 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-09a5ab1c-5173-45df-ac74-e5d691348b2f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:31.722503 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-09a5ab1c-5173-45df-ac74-e5d691348b2f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:31.723194 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-09a5ab1c-5173-45df-ac74-e5d691348b2f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:31.885315 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-09a5ab1c-5173-45df-ac74-e5d691348b2f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:32:31.894439 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-09a5ab1c-5173-45df-ac74-e5d691348b2f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715" status: 200 len: 1370 microversion: 2.1 time: 0.190646 Sep 30 19:32:31.895531 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 247/519] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:32:31 2022] GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715 => generated 1370 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:32:32.921453 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-ce60bcc1-fe82-4ead-aa10-d6b5cd189680 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:32:32.923376 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-ce60bcc1-fe82-4ead-aa10-d6b5cd189680 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:32:32.932407 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ce60bcc1-fe82-4ead-aa10-d6b5cd189680 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:32.935038 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ce60bcc1-fe82-4ead-aa10-d6b5cd189680 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:32.935737 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ce60bcc1-fe82-4ead-aa10-d6b5cd189680 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:32.938910 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ce60bcc1-fe82-4ead-aa10-d6b5cd189680 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:32.941734 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ce60bcc1-fe82-4ead-aa10-d6b5cd189680 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:32.942622 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ce60bcc1-fe82-4ead-aa10-d6b5cd189680 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:33.150011 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-ce60bcc1-fe82-4ead-aa10-d6b5cd189680 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:32:33.158048 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-ce60bcc1-fe82-4ead-aa10-d6b5cd189680 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715" status: 200 len: 1370 microversion: 2.1 time: 0.240588 Sep 30 19:32:33.168408 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 273/520] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:32:32 2022] GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715 => generated 1370 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:32:34.183135 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-f49b17da-108d-486a-b022-f5d2ca47c5f3 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:32:34.183739 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-f49b17da-108d-486a-b022-f5d2ca47c5f3 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:32:34.190134 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f49b17da-108d-486a-b022-f5d2ca47c5f3 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:34.190609 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f49b17da-108d-486a-b022-f5d2ca47c5f3 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:34.191037 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f49b17da-108d-486a-b022-f5d2ca47c5f3 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:34.191728 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f49b17da-108d-486a-b022-f5d2ca47c5f3 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:34.192197 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f49b17da-108d-486a-b022-f5d2ca47c5f3 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:34.192638 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f49b17da-108d-486a-b022-f5d2ca47c5f3 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:34.433155 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f49b17da-108d-486a-b022-f5d2ca47c5f3 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:32:34.441749 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-f49b17da-108d-486a-b022-f5d2ca47c5f3 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715" status: 200 len: 1370 microversion: 2.1 time: 0.262275 Sep 30 19:32:34.442561 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 248/521] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:32:34 2022] GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715 => generated 1370 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:32:35.466838 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-c73e3396-1e3f-4027-9c36-6436c9641273 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:32:35.467245 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-c73e3396-1e3f-4027-9c36-6436c9641273 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:32:35.477977 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c73e3396-1e3f-4027-9c36-6436c9641273 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:35.480492 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c73e3396-1e3f-4027-9c36-6436c9641273 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:35.482991 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c73e3396-1e3f-4027-9c36-6436c9641273 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:35.484531 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c73e3396-1e3f-4027-9c36-6436c9641273 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:35.485428 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c73e3396-1e3f-4027-9c36-6436c9641273 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:35.487149 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c73e3396-1e3f-4027-9c36-6436c9641273 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:35.668525 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-c73e3396-1e3f-4027-9c36-6436c9641273 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:32:35.671033 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell1:SELECT=99 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:32:35.679425 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-c73e3396-1e3f-4027-9c36-6436c9641273 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715" status: 200 len: 1370 microversion: 2.1 time: 0.218244 Sep 30 19:32:35.680171 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 274/522] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:32:35 2022] GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715 => generated 1370 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:32:35.692546 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-dccf703a-cf93-488c-8ae8-c4a101f96122 req-14af1abd-3990-4f15-bec5-a33879deac96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99020333-8572-4b29-bfa8-d5961bcde715", "name": "network-vif-plugged", "status": "completed", "tag": "21fca32a-5249-4344-9c8b-48685af3e0a7"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:32:35.699683 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-dccf703a-cf93-488c-8ae8-c4a101f96122 req-14af1abd-3990-4f15-bec5-a33879deac96 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:35.700214 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-dccf703a-cf93-488c-8ae8-c4a101f96122 req-14af1abd-3990-4f15-bec5-a33879deac96 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:35.700759 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-dccf703a-cf93-488c-8ae8-c4a101f96122 req-14af1abd-3990-4f15-bec5-a33879deac96 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:35.712319 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-dccf703a-cf93-488c-8ae8-c4a101f96122 req-14af1abd-3990-4f15-bec5-a33879deac96 service nova] Creating event network-vif-plugged:21fca32a-5249-4344-9c8b-48685af3e0a7 for instance 99020333-8572-4b29-bfa8-d5961bcde715 on hv-cinder-86001 Sep 30 19:32:35.717272 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-dccf703a-cf93-488c-8ae8-c4a101f96122 req-14af1abd-3990-4f15-bec5-a33879deac96 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032511 Sep 30 19:32:35.717985 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 249/523] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:32:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 30 19:32:36.703478 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-bd7ef993-eef6-4359-b2eb-8ebf899f241b tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:32:36.704292 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-bd7ef993-eef6-4359-b2eb-8ebf899f241b tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:32:36.711487 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-bd7ef993-eef6-4359-b2eb-8ebf899f241b tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:36.712250 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-bd7ef993-eef6-4359-b2eb-8ebf899f241b tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:36.712862 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-bd7ef993-eef6-4359-b2eb-8ebf899f241b tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:36.713810 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-bd7ef993-eef6-4359-b2eb-8ebf899f241b tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:36.714377 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-bd7ef993-eef6-4359-b2eb-8ebf899f241b tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:36.714910 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-bd7ef993-eef6-4359-b2eb-8ebf899f241b tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:36.888866 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-bd7ef993-eef6-4359-b2eb-8ebf899f241b tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:32:36.897105 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-bd7ef993-eef6-4359-b2eb-8ebf899f241b tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715" status: 200 len: 1370 microversion: 2.1 time: 0.197577 Sep 30 19:32:36.897684 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 275/524] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:32:36 2022] GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715 => generated 1370 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:32:37.924894 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-afa77906-1c8c-4c47-a58b-55580746c6d1 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:32:37.925517 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-afa77906-1c8c-4c47-a58b-55580746c6d1 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:32:37.932511 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-afa77906-1c8c-4c47-a58b-55580746c6d1 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:37.933188 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-afa77906-1c8c-4c47-a58b-55580746c6d1 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:37.934135 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-afa77906-1c8c-4c47-a58b-55580746c6d1 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:37.935233 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-afa77906-1c8c-4c47-a58b-55580746c6d1 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:37.935836 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-afa77906-1c8c-4c47-a58b-55580746c6d1 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:37.936642 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-afa77906-1c8c-4c47-a58b-55580746c6d1 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:38.104535 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-afa77906-1c8c-4c47-a58b-55580746c6d1 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:32:38.112942 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-afa77906-1c8c-4c47-a58b-55580746c6d1 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715" status: 200 len: 1370 microversion: 2.1 time: 0.192419 Sep 30 19:32:38.116567 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 250/525] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:32:37 2022] GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715 => generated 1370 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:32:39.136785 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-7c1b77bd-3851-4280-ad86-793b0c593000 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:32:39.137501 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-7c1b77bd-3851-4280-ad86-793b0c593000 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:32:39.144156 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7c1b77bd-3851-4280-ad86-793b0c593000 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:39.145292 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7c1b77bd-3851-4280-ad86-793b0c593000 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:39.146064 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7c1b77bd-3851-4280-ad86-793b0c593000 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:39.147081 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7c1b77bd-3851-4280-ad86-793b0c593000 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:39.147628 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7c1b77bd-3851-4280-ad86-793b0c593000 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:39.148260 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7c1b77bd-3851-4280-ad86-793b0c593000 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:39.287971 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-7c1b77bd-3851-4280-ad86-793b0c593000 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:32:39.296441 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-7c1b77bd-3851-4280-ad86-793b0c593000 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715" status: 200 len: 1370 microversion: 2.1 time: 0.164548 Sep 30 19:32:39.297271 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 276/526] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:32:39 2022] GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715 => generated 1370 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:32:40.319925 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-1c39902d-53f3-4135-8b13-b7917dd2d689 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:32:40.320548 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-1c39902d-53f3-4135-8b13-b7917dd2d689 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:32:40.327326 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1c39902d-53f3-4135-8b13-b7917dd2d689 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:40.327811 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1c39902d-53f3-4135-8b13-b7917dd2d689 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:40.328251 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1c39902d-53f3-4135-8b13-b7917dd2d689 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:40.329011 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1c39902d-53f3-4135-8b13-b7917dd2d689 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:40.329468 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1c39902d-53f3-4135-8b13-b7917dd2d689 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:40.329896 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1c39902d-53f3-4135-8b13-b7917dd2d689 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:40.333230 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=81 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:32:40.460639 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-1c39902d-53f3-4135-8b13-b7917dd2d689 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:32:40.468240 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-1c39902d-53f3-4135-8b13-b7917dd2d689 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715" status: 200 len: 1370 microversion: 2.1 time: 0.152643 Sep 30 19:32:40.468852 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 251/527] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:32:40 2022] GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715 => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:32:41.490825 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-874e87d7-016b-4ed1-8ab1-954a9ad2553f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:32:41.491424 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-874e87d7-016b-4ed1-8ab1-954a9ad2553f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:32:41.497344 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-874e87d7-016b-4ed1-8ab1-954a9ad2553f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:41.497821 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-874e87d7-016b-4ed1-8ab1-954a9ad2553f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:41.498252 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-874e87d7-016b-4ed1-8ab1-954a9ad2553f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:41.498934 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-874e87d7-016b-4ed1-8ab1-954a9ad2553f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:41.499379 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-874e87d7-016b-4ed1-8ab1-954a9ad2553f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:41.499799 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-874e87d7-016b-4ed1-8ab1-954a9ad2553f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:41.627014 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-874e87d7-016b-4ed1-8ab1-954a9ad2553f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:32:41.634525 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-874e87d7-016b-4ed1-8ab1-954a9ad2553f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715" status: 200 len: 1370 microversion: 2.1 time: 0.147580 Sep 30 19:32:41.635085 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 277/528] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:32:41 2022] GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715 => generated 1370 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:32:42.657786 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-bb79a0de-8b33-4bbc-b799-79f0ce3d9687 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:32:42.658320 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-bb79a0de-8b33-4bbc-b799-79f0ce3d9687 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:32:42.665594 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bb79a0de-8b33-4bbc-b799-79f0ce3d9687 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:42.666064 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bb79a0de-8b33-4bbc-b799-79f0ce3d9687 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:42.666508 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bb79a0de-8b33-4bbc-b799-79f0ce3d9687 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:42.667198 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bb79a0de-8b33-4bbc-b799-79f0ce3d9687 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:42.667652 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bb79a0de-8b33-4bbc-b799-79f0ce3d9687 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:42.668079 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bb79a0de-8b33-4bbc-b799-79f0ce3d9687 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:42.803484 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-bb79a0de-8b33-4bbc-b799-79f0ce3d9687 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:32:42.811030 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-bb79a0de-8b33-4bbc-b799-79f0ce3d9687 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715" status: 200 len: 1370 microversion: 2.1 time: 0.157248 Sep 30 19:32:42.811581 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 252/529] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:32:42 2022] GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715 => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:32:43.833988 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-ed8cd40d-8448-4066-baab-2abbc603a7b7 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:32:43.834595 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-ed8cd40d-8448-4066-baab-2abbc603a7b7 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:32:43.840440 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ed8cd40d-8448-4066-baab-2abbc603a7b7 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:43.840925 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ed8cd40d-8448-4066-baab-2abbc603a7b7 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:43.841358 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ed8cd40d-8448-4066-baab-2abbc603a7b7 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:43.842039 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ed8cd40d-8448-4066-baab-2abbc603a7b7 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:43.842489 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ed8cd40d-8448-4066-baab-2abbc603a7b7 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:43.842914 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ed8cd40d-8448-4066-baab-2abbc603a7b7 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:43.967200 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-ed8cd40d-8448-4066-baab-2abbc603a7b7 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:32:43.975337 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-ed8cd40d-8448-4066-baab-2abbc603a7b7 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715" status: 200 len: 1370 microversion: 2.1 time: 0.145139 Sep 30 19:32:43.975894 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 278/530] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:32:43 2022] GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715 => generated 1370 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:32:44.998044 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-73db502e-55a5-4d32-ab79-32add687be56 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:32:44.998649 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-73db502e-55a5-4d32-ab79-32add687be56 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:32:45.004956 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-73db502e-55a5-4d32-ab79-32add687be56 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:45.005434 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-73db502e-55a5-4d32-ab79-32add687be56 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:45.006167 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-73db502e-55a5-4d32-ab79-32add687be56 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:45.006537 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-73db502e-55a5-4d32-ab79-32add687be56 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:45.006988 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-73db502e-55a5-4d32-ab79-32add687be56 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:45.007408 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-73db502e-55a5-4d32-ab79-32add687be56 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:45.131980 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-73db502e-55a5-4d32-ab79-32add687be56 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:32:45.139571 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-73db502e-55a5-4d32-ab79-32add687be56 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715" status: 200 len: 1370 microversion: 2.1 time: 0.145255 Sep 30 19:32:45.140069 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 253/531] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:32:44 2022] GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715 => generated 1370 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:32:46.164074 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-e730ff60-7dfc-45b0-9c58-9288d00834b0 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:32:46.164734 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-e730ff60-7dfc-45b0-9c58-9288d00834b0 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:32:46.170688 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e730ff60-7dfc-45b0-9c58-9288d00834b0 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:46.171170 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e730ff60-7dfc-45b0-9c58-9288d00834b0 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:46.171606 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e730ff60-7dfc-45b0-9c58-9288d00834b0 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:46.172297 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e730ff60-7dfc-45b0-9c58-9288d00834b0 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:46.172796 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e730ff60-7dfc-45b0-9c58-9288d00834b0 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:46.173221 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e730ff60-7dfc-45b0-9c58-9288d00834b0 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:46.304176 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-e730ff60-7dfc-45b0-9c58-9288d00834b0 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:32:46.312310 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-e730ff60-7dfc-45b0-9c58-9288d00834b0 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715" status: 200 len: 1564 microversion: 2.1 time: 0.152218 Sep 30 19:32:46.313373 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 279/532] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:32:46 2022] GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715 => generated 1564 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:32:46.337213 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-eebe9181-c19a-4621-966f-a50b3b12202e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:32:46.337840 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-eebe9181-c19a-4621-966f-a50b3b12202e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:32:46.344252 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-eebe9181-c19a-4621-966f-a50b3b12202e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:46.344596 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-eebe9181-c19a-4621-966f-a50b3b12202e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:46.345028 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-eebe9181-c19a-4621-966f-a50b3b12202e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:46.345713 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-eebe9181-c19a-4621-966f-a50b3b12202e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:46.346159 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-eebe9181-c19a-4621-966f-a50b3b12202e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:46.346581 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-eebe9181-c19a-4621-966f-a50b3b12202e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:46.425630 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-eebe9181-c19a-4621-966f-a50b3b12202e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093667 Sep 30 19:32:46.434129 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 254/533] 10.222.0.17 () {58 vars in 1275 bytes} [Fri Sep 30 19:32:46 2022] GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:32:47.352694 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [req-451e55f0-5417-4efa-97d2-e9f8ae004aa9 req-8889b690-f23e-4ae4-8f85-1bc2dcdda4c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99020333-8572-4b29-bfa8-d5961bcde715", "tag": "21fca32a-5249-4344-9c8b-48685af3e0a7"}]} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:32:47.362132 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-451e55f0-5417-4efa-97d2-e9f8ae004aa9 req-8889b690-f23e-4ae4-8f85-1bc2dcdda4c0 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:32:47.362598 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-451e55f0-5417-4efa-97d2-e9f8ae004aa9 req-8889b690-f23e-4ae4-8f85-1bc2dcdda4c0 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:32:47.363022 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-451e55f0-5417-4efa-97d2-e9f8ae004aa9 req-8889b690-f23e-4ae4-8f85-1bc2dcdda4c0 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:32:47.375094 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.compute.server_external_events [req-451e55f0-5417-4efa-97d2-e9f8ae004aa9 req-8889b690-f23e-4ae4-8f85-1bc2dcdda4c0 service nova] Creating event network-changed:21fca32a-5249-4344-9c8b-48685af3e0a7 for instance 99020333-8572-4b29-bfa8-d5961bcde715 on hv-cinder-86001 Sep 30 19:32:47.381914 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [req-451e55f0-5417-4efa-97d2-e9f8ae004aa9 req-8889b690-f23e-4ae4-8f85-1bc2dcdda4c0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033082 Sep 30 19:32:47.382544 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 280/534] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:33:21.595012 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=27 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:33:21.595751 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=21 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:33:21.600539 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-d67652b7-4fce-4003-83fb-12626774b249 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:33:21.601028 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-d67652b7-4fce-4003-83fb-12626774b249 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:33:21.607715 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d67652b7-4fce-4003-83fb-12626774b249 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:21.608189 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d67652b7-4fce-4003-83fb-12626774b249 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:21.608652 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d67652b7-4fce-4003-83fb-12626774b249 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:21.609327 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d67652b7-4fce-4003-83fb-12626774b249 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:21.609773 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d67652b7-4fce-4003-83fb-12626774b249 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:21.610200 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d67652b7-4fce-4003-83fb-12626774b249 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:21.633055 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-d67652b7-4fce-4003-83fb-12626774b249 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d/ips" status: 200 len: 148 microversion: 2.1 time: 0.039798 Sep 30 19:33:21.633603 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 255/535] 10.222.0.17 () {58 vars in 1248 bytes} [Fri Sep 30 19:33:21 2022] GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d/ips => generated 148 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:33:24.040618 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-5b9afb53-f1e0-4d2f-a320-b1a383d86d7c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2d7dd76d-f183-441b-8efa-2211585fc684"}} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:33:24.043015 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-5b9afb53-f1e0-4d2f-a320-b1a383d86d7c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:33:24.045121 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_api:SELECT=27 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:33:24.045758 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell1:SELECT=33 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:33:24.052182 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5b9afb53-f1e0-4d2f-a320-b1a383d86d7c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:24.053218 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5b9afb53-f1e0-4d2f-a320-b1a383d86d7c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:24.053653 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5b9afb53-f1e0-4d2f-a320-b1a383d86d7c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:24.054408 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5b9afb53-f1e0-4d2f-a320-b1a383d86d7c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:24.054856 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5b9afb53-f1e0-4d2f-a320-b1a383d86d7c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:24.055276 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5b9afb53-f1e0-4d2f-a320-b1a383d86d7c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:24.257046 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-c79e85fd-3ced-4198-a157-c3905fe9118b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:33:24.257539 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-c79e85fd-3ced-4198-a157-c3905fe9118b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:33:24.264095 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c79e85fd-3ced-4198-a157-c3905fe9118b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:24.264610 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c79e85fd-3ced-4198-a157-c3905fe9118b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:24.265050 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c79e85fd-3ced-4198-a157-c3905fe9118b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:24.265736 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c79e85fd-3ced-4198-a157-c3905fe9118b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:24.266184 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c79e85fd-3ced-4198-a157-c3905fe9118b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:24.266605 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c79e85fd-3ced-4198-a157-c3905fe9118b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:24.293254 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-c79e85fd-3ced-4198-a157-c3905fe9118b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9/ips" status: 200 len: 145 microversion: 2.1 time: 0.040682 Sep 30 19:33:24.293832 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 256/536] 10.222.0.17 () {58 vars in 1248 bytes} [Fri Sep 30 19:33:24 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9/ips => generated 145 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:33:24.340752 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-5b9afb53-f1e0-4d2f-a320-b1a383d86d7c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "POST /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.304315 Sep 30 19:33:24.341437 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 281/537] 10.222.0.17 () {60 vars in 1323 bytes} [Fri Sep 30 19:33:24 2022] POST /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:33:27.764238 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-6de95963-9f92-4c48-9afa-27ac72fc90ac tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f74a1448-33b0-4e4c-8441-565010aefc13"}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:33:27.766588 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-6de95963-9f92-4c48-9afa-27ac72fc90ac tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:33:27.773007 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6de95963-9f92-4c48-9afa-27ac72fc90ac tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:27.773504 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6de95963-9f92-4c48-9afa-27ac72fc90ac tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:27.773946 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6de95963-9f92-4c48-9afa-27ac72fc90ac tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:27.774642 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6de95963-9f92-4c48-9afa-27ac72fc90ac tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:27.775102 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6de95963-9f92-4c48-9afa-27ac72fc90ac tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:27.775534 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6de95963-9f92-4c48-9afa-27ac72fc90ac tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:28.046324 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-6de95963-9f92-4c48-9afa-27ac72fc90ac tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "POST /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285863 Sep 30 19:33:28.046919 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 257/538] 10.222.0.17 () {60 vars in 1323 bytes} [Fri Sep 30 19:33:27 2022] POST /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9/os-volume_attachments => generated 194 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:33:31.872425 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-117596ae-948f-443d-9748-61dee50a784f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Action: 'create', calling method: .version_select at 0x7f621f41e8b0>, body: {"keypair": {"name": "tempest-keypair-1678727989", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJjoc9eIhn7pAbCaZxpsE8oCe+L/eAtRyDN/OzUmcmOFdz+DW/z0Ohy1qX/mU4wBnKy3rwgrqa7uDPwLC2eT55Onmp+slKXSPpYO9BYiO6Ef2Tgo6P37QIZVGGIxKgyZLw=="}} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:33:31.888077 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.quota [None req-117596ae-948f-443d-9748-61dee50a784f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Getting quotas for project 612fb8a339e4478ba78bc5ef3b343b82. Resources: {'key_pairs'} {{(pid=120649) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 30 19:33:31.891761 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.quota [None req-117596ae-948f-443d-9748-61dee50a784f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Getting quotas for user ccbdadc310fc4bf8a6679bcb39b34ff1 and project 612fb8a339e4478ba78bc5ef3b343b82. Resources: {'key_pairs'} {{(pid=120649) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 30 19:33:31.913556 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-117596ae-948f-443d-9748-61dee50a784f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045772 Sep 30 19:33:31.914108 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 282/539] 10.222.0.17 () {60 vars in 1159 bytes} [Fri Sep 30 19:33:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:33:33.145697 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-ff23f344-1b10-4926-8c8b-f8340bac72fd tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1784772853", "imageRef": "7714d055-7d2c-4f56-9b14-45324361e286", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0c1e5405-3945-456e-8e1d-e94d5c819889"}], "security_groups": [{"name": "tempest-securitygroup--2045207122"}], "key_name": "tempest-keypair-1678727989", "user_data": "}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:33:33.247869 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.network.neutron [None req-ff23f344-1b10-4926-8c8b-f8340bac72fd tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] validate_networks() for [('0c1e5405-3945-456e-8e1d-e94d5c819889', None, None, None, None, None)] {{(pid=120648) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 30 19:33:33.828439 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-ff23f344-1b10-4926-8c8b-f8340bac72fd tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Flavor limits 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 30 19:33:33.828870 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-ff23f344-1b10-4926-8c8b-f8340bac72fd tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Image limits 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 30 19:33:33.829375 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-ff23f344-1b10-4926-8c8b-f8340bac72fd tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Flavor pref 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 30 19:33:33.829785 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-ff23f344-1b10-4926-8c8b-f8340bac72fd tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Image pref 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 30 19:33:33.830199 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-ff23f344-1b10-4926-8c8b-f8340bac72fd tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 30 19:33:33.839408 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ff23f344-1b10-4926-8c8b-f8340bac72fd tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:33.839888 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ff23f344-1b10-4926-8c8b-f8340bac72fd tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:33.840320 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ff23f344-1b10-4926-8c8b-f8340bac72fd tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:33.841086 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ff23f344-1b10-4926-8c8b-f8340bac72fd tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:33.841537 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ff23f344-1b10-4926-8c8b-f8340bac72fd tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:33.841959 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ff23f344-1b10-4926-8c8b-f8340bac72fd tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:33.859056 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-ff23f344-1b10-4926-8c8b-f8340bac72fd tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Getting quotas for project 612fb8a339e4478ba78bc5ef3b343b82. Resources: {'instances', 'ram', 'cores'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 30 19:33:33.862953 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-ff23f344-1b10-4926-8c8b-f8340bac72fd tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Getting quotas for user ccbdadc310fc4bf8a6679bcb39b34ff1 and project 612fb8a339e4478ba78bc5ef3b343b82. Resources: {'instances', 'ram', 'cores'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 30 19:33:33.873653 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-ff23f344-1b10-4926-8c8b-f8340bac72fd tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Going to run 1 instances... {{(pid=120648) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 30 19:33:33.875958 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-ff23f344-1b10-4926-8c8b-f8340bac72fd tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: e7a95413-7db3-443f-b375-3ddf2f3f6f1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7714d055-7d2c-4f56-9b14-45324361e286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 30 19:33:33.923265 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-ff23f344-1b10-4926-8c8b-f8340bac72fd tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.782831 Sep 30 19:33:33.923895 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 258/540] 10.222.0.17 () {60 vars in 1147 bytes} [Fri Sep 30 19:33:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 30 19:33:33.936068 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-dd472837-8cb9-4ec6-800a-206cb0076f6e tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:33:33.936903 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-dd472837-8cb9-4ec6-800a-206cb0076f6e tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: e7a95413-7db3-443f-b375-3ddf2f3f6f1b] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:33:33.996215 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-dd472837-8cb9-4ec6-800a-206cb0076f6e tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:34.003128 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-dd472837-8cb9-4ec6-800a-206cb0076f6e tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/e7a95413-7db3-443f-b375-3ddf2f3f6f1b" status: 200 len: 1242 microversion: 2.1 time: 0.071429 Sep 30 19:33:34.003695 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 283/541] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:33:33 2022] GET /compute/v2.1/servers/e7a95413-7db3-443f-b375-3ddf2f3f6f1b => generated 1242 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:33:35.025801 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-859bf3d0-0dd6-4cbf-b61b-c00a862de7b3 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:33:35.026409 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-859bf3d0-0dd6-4cbf-b61b-c00a862de7b3 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: e7a95413-7db3-443f-b375-3ddf2f3f6f1b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:33:35.032714 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-859bf3d0-0dd6-4cbf-b61b-c00a862de7b3 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:35.033192 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-859bf3d0-0dd6-4cbf-b61b-c00a862de7b3 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:35.033711 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-859bf3d0-0dd6-4cbf-b61b-c00a862de7b3 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:35.034542 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-859bf3d0-0dd6-4cbf-b61b-c00a862de7b3 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:35.034987 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-859bf3d0-0dd6-4cbf-b61b-c00a862de7b3 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:35.035405 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-859bf3d0-0dd6-4cbf-b61b-c00a862de7b3 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:35.098352 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-859bf3d0-0dd6-4cbf-b61b-c00a862de7b3 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:35.106363 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-859bf3d0-0dd6-4cbf-b61b-c00a862de7b3 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/e7a95413-7db3-443f-b375-3ddf2f3f6f1b" status: 200 len: 1294 microversion: 2.1 time: 0.084867 Sep 30 19:33:35.106922 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 259/542] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:33:35 2022] GET /compute/v2.1/servers/e7a95413-7db3-443f-b375-3ddf2f3f6f1b => generated 1294 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:33:36.131206 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-8b57ebb6-5cb6-42f9-aa05-901ad44114c4 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:33:36.131955 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-8b57ebb6-5cb6-42f9-aa05-901ad44114c4 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: e7a95413-7db3-443f-b375-3ddf2f3f6f1b] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:33:36.136769 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:33:36.141480 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8b57ebb6-5cb6-42f9-aa05-901ad44114c4 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:36.142069 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8b57ebb6-5cb6-42f9-aa05-901ad44114c4 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:36.142585 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8b57ebb6-5cb6-42f9-aa05-901ad44114c4 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:36.143723 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8b57ebb6-5cb6-42f9-aa05-901ad44114c4 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:36.144397 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8b57ebb6-5cb6-42f9-aa05-901ad44114c4 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:36.144904 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8b57ebb6-5cb6-42f9-aa05-901ad44114c4 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:36.269736 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-736c0e14-81b0-43c6-aaee-64cd029ca010 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:33:36.270361 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-736c0e14-81b0-43c6-aaee-64cd029ca010 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:33:36.276738 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-736c0e14-81b0-43c6-aaee-64cd029ca010 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:36.277452 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-736c0e14-81b0-43c6-aaee-64cd029ca010 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:36.278002 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-736c0e14-81b0-43c6-aaee-64cd029ca010 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:36.278735 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-736c0e14-81b0-43c6-aaee-64cd029ca010 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:36.279188 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-736c0e14-81b0-43c6-aaee-64cd029ca010 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:36.279633 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-736c0e14-81b0-43c6-aaee-64cd029ca010 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:36.280981 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-8b57ebb6-5cb6-42f9-aa05-901ad44114c4 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:36.289272 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-8b57ebb6-5cb6-42f9-aa05-901ad44114c4 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/e7a95413-7db3-443f-b375-3ddf2f3f6f1b" status: 200 len: 1368 microversion: 2.1 time: 0.163229 Sep 30 19:33:36.289839 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 284/543] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:33:36 2022] GET /compute/v2.1/servers/e7a95413-7db3-443f-b375-3ddf2f3f6f1b => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:33:36.315372 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-736c0e14-81b0-43c6-aaee-64cd029ca010 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df/ips" status: 200 len: 150 microversion: 2.20 time: 0.049581 Sep 30 19:33:36.316548 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 260/544] 10.222.0.17 () {60 vars in 1289 bytes} [Fri Sep 30 19:33:36 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df/ips => generated 150 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 30 19:33:36.837818 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [req-b9d30017-941f-4450-ba87-a766e164e1d0 req-e8bc6ce5-1834-49fd-a922-76841c8108b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7a95413-7db3-443f-b375-3ddf2f3f6f1b", "tag": "7e028764-652a-4dc7-a348-c7dc9749c9b9"}]} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:33:36.847982 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-b9d30017-941f-4450-ba87-a766e164e1d0 req-e8bc6ce5-1834-49fd-a922-76841c8108b9 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:36.848497 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-b9d30017-941f-4450-ba87-a766e164e1d0 req-e8bc6ce5-1834-49fd-a922-76841c8108b9 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:36.848921 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-b9d30017-941f-4450-ba87-a766e164e1d0 req-e8bc6ce5-1834-49fd-a922-76841c8108b9 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:36.860080 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.compute.server_external_events [req-b9d30017-941f-4450-ba87-a766e164e1d0 req-e8bc6ce5-1834-49fd-a922-76841c8108b9 service nova] Creating event network-changed:7e028764-652a-4dc7-a348-c7dc9749c9b9 for instance e7a95413-7db3-443f-b375-3ddf2f3f6f1b on hv-cinder-86001 Sep 30 19:33:36.865425 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [req-b9d30017-941f-4450-ba87-a766e164e1d0 req-e8bc6ce5-1834-49fd-a922-76841c8108b9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031254 Sep 30 19:33:36.866014 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 285/545] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:33:37.312783 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-83d3250e-3165-4733-a21e-dbcfc6685789 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:33:37.313298 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-83d3250e-3165-4733-a21e-dbcfc6685789 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: e7a95413-7db3-443f-b375-3ddf2f3f6f1b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:33:37.319618 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-83d3250e-3165-4733-a21e-dbcfc6685789 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:37.320095 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-83d3250e-3165-4733-a21e-dbcfc6685789 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:37.320560 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-83d3250e-3165-4733-a21e-dbcfc6685789 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:37.321248 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-83d3250e-3165-4733-a21e-dbcfc6685789 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:37.321696 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-83d3250e-3165-4733-a21e-dbcfc6685789 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:37.322115 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-83d3250e-3165-4733-a21e-dbcfc6685789 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:37.451413 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-83d3250e-3165-4733-a21e-dbcfc6685789 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:37.459754 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-83d3250e-3165-4733-a21e-dbcfc6685789 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/e7a95413-7db3-443f-b375-3ddf2f3f6f1b" status: 200 len: 1368 microversion: 2.1 time: 0.150812 Sep 30 19:33:37.460319 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 261/546] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:33:37 2022] GET /compute/v2.1/servers/e7a95413-7db3-443f-b375-3ddf2f3f6f1b => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:33:38.482801 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-c6ff84a9-79e3-4a0b-99a3-aeed116ae145 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:33:38.483573 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-c6ff84a9-79e3-4a0b-99a3-aeed116ae145 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: e7a95413-7db3-443f-b375-3ddf2f3f6f1b] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:33:38.489811 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c6ff84a9-79e3-4a0b-99a3-aeed116ae145 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:38.490340 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c6ff84a9-79e3-4a0b-99a3-aeed116ae145 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:38.490827 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c6ff84a9-79e3-4a0b-99a3-aeed116ae145 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:38.491609 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c6ff84a9-79e3-4a0b-99a3-aeed116ae145 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:38.492140 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c6ff84a9-79e3-4a0b-99a3-aeed116ae145 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:38.492639 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c6ff84a9-79e3-4a0b-99a3-aeed116ae145 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:38.526904 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-87b21766-abf1-4fe4-bba8-bf7ff0572e41 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:33:38.527677 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-87b21766-abf1-4fe4-bba8-bf7ff0572e41 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:33:38.534623 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-87b21766-abf1-4fe4-bba8-bf7ff0572e41 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:38.535317 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-87b21766-abf1-4fe4-bba8-bf7ff0572e41 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:38.535749 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-87b21766-abf1-4fe4-bba8-bf7ff0572e41 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:38.536610 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-87b21766-abf1-4fe4-bba8-bf7ff0572e41 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:38.537842 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-87b21766-abf1-4fe4-bba8-bf7ff0572e41 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:38.538271 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-87b21766-abf1-4fe4-bba8-bf7ff0572e41 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:38.561306 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.objects.instance [None req-87b21766-abf1-4fe4-bba8-bf7ff0572e41 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lazy-loading 'flavor' on Instance uuid c87cf7d2-5d47-474b-b2f0-1ddc37bc97df {{(pid=120648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 30 19:33:38.625766 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-c6ff84a9-79e3-4a0b-99a3-aeed116ae145 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:38.633548 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-c6ff84a9-79e3-4a0b-99a3-aeed116ae145 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/e7a95413-7db3-443f-b375-3ddf2f3f6f1b" status: 200 len: 1368 microversion: 2.1 time: 0.155496 Sep 30 19:33:38.634198 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 286/547] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:33:38 2022] GET /compute/v2.1/servers/e7a95413-7db3-443f-b375-3ddf2f3f6f1b => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:33:38.786876 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-87b21766-abf1-4fe4-bba8-bf7ff0572e41 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "POST /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df/action" status: 202 len: 0 microversion: 2.20 time: 0.263634 Sep 30 19:33:38.787473 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 262/548] 10.222.0.17 () {62 vars in 1319 bytes} [Fri Sep 30 19:33:38 2022] POST /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 30 19:33:38.795689 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-8553ebd8-0817-4093-bb0f-83e82aff1809 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:33:38.796301 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-8553ebd8-0817-4093-bb0f-83e82aff1809 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:33:38.802313 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8553ebd8-0817-4093-bb0f-83e82aff1809 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:38.802829 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8553ebd8-0817-4093-bb0f-83e82aff1809 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:38.803268 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8553ebd8-0817-4093-bb0f-83e82aff1809 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:38.803962 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8553ebd8-0817-4093-bb0f-83e82aff1809 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:38.804437 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8553ebd8-0817-4093-bb0f-83e82aff1809 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:38.804865 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8553ebd8-0817-4093-bb0f-83e82aff1809 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:38.935446 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-8553ebd8-0817-4093-bb0f-83e82aff1809 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:38.943862 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-8553ebd8-0817-4093-bb0f-83e82aff1809 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:38.945312 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-8553ebd8-0817-4093-bb0f-83e82aff1809 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:38.946458 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-8553ebd8-0817-4093-bb0f-83e82aff1809 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1721 microversion: 2.20 time: 0.154801 Sep 30 19:33:38.947036 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 287/549] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:33:38 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:33:39.658117 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-1aab9538-78d5-4119-874d-85c1afad245e tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:33:39.658782 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-1aab9538-78d5-4119-874d-85c1afad245e tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: e7a95413-7db3-443f-b375-3ddf2f3f6f1b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:33:39.665758 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1aab9538-78d5-4119-874d-85c1afad245e tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:39.666233 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1aab9538-78d5-4119-874d-85c1afad245e tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:39.666662 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1aab9538-78d5-4119-874d-85c1afad245e tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:39.667342 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1aab9538-78d5-4119-874d-85c1afad245e tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:39.667794 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1aab9538-78d5-4119-874d-85c1afad245e tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:39.668212 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1aab9538-78d5-4119-874d-85c1afad245e tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:39.799078 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-1aab9538-78d5-4119-874d-85c1afad245e tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:39.807498 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-1aab9538-78d5-4119-874d-85c1afad245e tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/e7a95413-7db3-443f-b375-3ddf2f3f6f1b" status: 200 len: 1368 microversion: 2.1 time: 0.154208 Sep 30 19:33:39.808054 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 263/550] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:33:39 2022] GET /compute/v2.1/servers/e7a95413-7db3-443f-b375-3ddf2f3f6f1b => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:33:39.971941 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-55507e29-c47e-4a9d-be72-4645764c73d8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:33:39.972573 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-55507e29-c47e-4a9d-be72-4645764c73d8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:33:39.979439 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-55507e29-c47e-4a9d-be72-4645764c73d8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:39.979989 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-55507e29-c47e-4a9d-be72-4645764c73d8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:39.980469 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-55507e29-c47e-4a9d-be72-4645764c73d8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:39.981159 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-55507e29-c47e-4a9d-be72-4645764c73d8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:39.981609 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-55507e29-c47e-4a9d-be72-4645764c73d8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:39.982033 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-55507e29-c47e-4a9d-be72-4645764c73d8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:40.106852 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-55507e29-c47e-4a9d-be72-4645764c73d8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:40.114751 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-55507e29-c47e-4a9d-be72-4645764c73d8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:40.116181 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-55507e29-c47e-4a9d-be72-4645764c73d8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:40.117362 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-55507e29-c47e-4a9d-be72-4645764c73d8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1721 microversion: 2.20 time: 0.149244 Sep 30 19:33:40.117916 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 288/551] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:33:39 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:33:40.830624 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-6289e084-bca6-4556-ac28-42c1a55b0a33 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:33:40.831373 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-6289e084-bca6-4556-ac28-42c1a55b0a33 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: e7a95413-7db3-443f-b375-3ddf2f3f6f1b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:33:40.837773 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6289e084-bca6-4556-ac28-42c1a55b0a33 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:40.838277 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6289e084-bca6-4556-ac28-42c1a55b0a33 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:40.838704 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6289e084-bca6-4556-ac28-42c1a55b0a33 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:40.839399 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6289e084-bca6-4556-ac28-42c1a55b0a33 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:40.839820 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6289e084-bca6-4556-ac28-42c1a55b0a33 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:40.840237 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6289e084-bca6-4556-ac28-42c1a55b0a33 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:40.969742 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-6289e084-bca6-4556-ac28-42c1a55b0a33 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:40.978009 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-6289e084-bca6-4556-ac28-42c1a55b0a33 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/e7a95413-7db3-443f-b375-3ddf2f3f6f1b" status: 200 len: 1368 microversion: 2.1 time: 0.151148 Sep 30 19:33:40.978560 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 264/552] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:33:40 2022] GET /compute/v2.1/servers/e7a95413-7db3-443f-b375-3ddf2f3f6f1b => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:33:41.142931 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-3512e4f4-1512-4719-a3bd-eaea3101f975 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:33:41.143474 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-3512e4f4-1512-4719-a3bd-eaea3101f975 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:33:41.149861 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3512e4f4-1512-4719-a3bd-eaea3101f975 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:41.150346 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3512e4f4-1512-4719-a3bd-eaea3101f975 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:41.150783 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3512e4f4-1512-4719-a3bd-eaea3101f975 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:41.151477 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3512e4f4-1512-4719-a3bd-eaea3101f975 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:41.151934 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3512e4f4-1512-4719-a3bd-eaea3101f975 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:41.152362 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3512e4f4-1512-4719-a3bd-eaea3101f975 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:41.283594 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-3512e4f4-1512-4719-a3bd-eaea3101f975 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:41.292311 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-3512e4f4-1512-4719-a3bd-eaea3101f975 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:41.293761 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-3512e4f4-1512-4719-a3bd-eaea3101f975 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:41.294911 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-3512e4f4-1512-4719-a3bd-eaea3101f975 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1721 microversion: 2.20 time: 0.156034 Sep 30 19:33:41.295471 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 289/553] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:33:41 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:33:42.000912 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-5f35c86f-7f28-412c-aa16-aae30b10cdff tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:33:42.001526 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-5f35c86f-7f28-412c-aa16-aae30b10cdff tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: e7a95413-7db3-443f-b375-3ddf2f3f6f1b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:33:42.008056 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5f35c86f-7f28-412c-aa16-aae30b10cdff tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:42.008602 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5f35c86f-7f28-412c-aa16-aae30b10cdff tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:42.009026 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5f35c86f-7f28-412c-aa16-aae30b10cdff tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:42.009725 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5f35c86f-7f28-412c-aa16-aae30b10cdff tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:42.010176 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5f35c86f-7f28-412c-aa16-aae30b10cdff tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:42.010603 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5f35c86f-7f28-412c-aa16-aae30b10cdff tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:42.141626 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-5f35c86f-7f28-412c-aa16-aae30b10cdff tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:42.149307 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-5f35c86f-7f28-412c-aa16-aae30b10cdff tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/e7a95413-7db3-443f-b375-3ddf2f3f6f1b" status: 200 len: 1368 microversion: 2.1 time: 0.152548 Sep 30 19:33:42.149863 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 265/554] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:33:41 2022] GET /compute/v2.1/servers/e7a95413-7db3-443f-b375-3ddf2f3f6f1b => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:33:42.324387 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-555da22d-9e3c-4452-a3f0-6f70e3f33a2f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:33:42.324918 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-555da22d-9e3c-4452-a3f0-6f70e3f33a2f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:33:42.331377 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-555da22d-9e3c-4452-a3f0-6f70e3f33a2f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:42.331886 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-555da22d-9e3c-4452-a3f0-6f70e3f33a2f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:42.332350 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-555da22d-9e3c-4452-a3f0-6f70e3f33a2f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:42.333057 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-555da22d-9e3c-4452-a3f0-6f70e3f33a2f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:42.333532 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-555da22d-9e3c-4452-a3f0-6f70e3f33a2f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:42.333951 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-555da22d-9e3c-4452-a3f0-6f70e3f33a2f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:42.482333 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-555da22d-9e3c-4452-a3f0-6f70e3f33a2f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:42.491811 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-555da22d-9e3c-4452-a3f0-6f70e3f33a2f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:42.493479 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-555da22d-9e3c-4452-a3f0-6f70e3f33a2f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:42.494794 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-555da22d-9e3c-4452-a3f0-6f70e3f33a2f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1721 microversion: 2.20 time: 0.174537 Sep 30 19:33:42.495586 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 290/555] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:33:42 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:33:43.049733 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-db91d130-8025-4c79-80fd-c94cb26c0f18 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:33:43.056622 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-db91d130-8025-4c79-80fd-c94cb26c0f18 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:43.057104 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-db91d130-8025-4c79-80fd-c94cb26c0f18 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:43.057574 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-db91d130-8025-4c79-80fd-c94cb26c0f18 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:43.118655 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-db91d130-8025-4c79-80fd-c94cb26c0f18 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Going to try to stop instance {{(pid=120648) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 30 19:33:43.161250 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-db91d130-8025-4c79-80fd-c94cb26c0f18 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "POST /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9/action" status: 202 len: 0 microversion: 2.1 time: 0.115134 Sep 30 19:33:43.162308 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 266/556] 10.222.0.17 () {60 vars in 1278 bytes} [Fri Sep 30 19:33:43 2022] POST /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 30 19:33:43.173233 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-580867a4-1180-40b1-a5b7-74635870a0c5 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:33:43.173758 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-6d8edd2e-0f98-466b-8cf1-695c912149e1 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:33:43.173973 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-580867a4-1180-40b1-a5b7-74635870a0c5 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: e7a95413-7db3-443f-b375-3ddf2f3f6f1b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:33:43.174866 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-6d8edd2e-0f98-466b-8cf1-695c912149e1 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:33:43.182256 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-580867a4-1180-40b1-a5b7-74635870a0c5 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:43.182746 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-580867a4-1180-40b1-a5b7-74635870a0c5 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:43.183321 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-580867a4-1180-40b1-a5b7-74635870a0c5 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:43.184054 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-580867a4-1180-40b1-a5b7-74635870a0c5 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:43.184522 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-580867a4-1180-40b1-a5b7-74635870a0c5 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:43.184988 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-580867a4-1180-40b1-a5b7-74635870a0c5 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:43.185566 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6d8edd2e-0f98-466b-8cf1-695c912149e1 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:43.186489 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6d8edd2e-0f98-466b-8cf1-695c912149e1 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:43.186997 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6d8edd2e-0f98-466b-8cf1-695c912149e1 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:43.188226 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6d8edd2e-0f98-466b-8cf1-695c912149e1 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:43.188871 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6d8edd2e-0f98-466b-8cf1-695c912149e1 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:43.189583 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6d8edd2e-0f98-466b-8cf1-695c912149e1 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:43.321304 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-580867a4-1180-40b1-a5b7-74635870a0c5 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:43.323157 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-6d8edd2e-0f98-466b-8cf1-695c912149e1 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:43.329567 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-580867a4-1180-40b1-a5b7-74635870a0c5 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/e7a95413-7db3-443f-b375-3ddf2f3f6f1b" status: 200 len: 1368 microversion: 2.1 time: 0.160315 Sep 30 19:33:43.330140 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 267/557] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:33:43 2022] GET /compute/v2.1/servers/e7a95413-7db3-443f-b375-3ddf2f3f6f1b => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:33:43.331680 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-6d8edd2e-0f98-466b-8cf1-695c912149e1 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1723 microversion: 2.1 time: 0.165003 Sep 30 19:33:43.332438 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 291/558] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:33:43 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:33:43.523856 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-37a0c40b-04aa-4e54-b101-ce12cee1373c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:33:43.524485 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-37a0c40b-04aa-4e54-b101-ce12cee1373c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:33:43.530323 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-37a0c40b-04aa-4e54-b101-ce12cee1373c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:43.530801 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-37a0c40b-04aa-4e54-b101-ce12cee1373c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:43.531234 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-37a0c40b-04aa-4e54-b101-ce12cee1373c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:43.531916 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-37a0c40b-04aa-4e54-b101-ce12cee1373c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:43.532386 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-37a0c40b-04aa-4e54-b101-ce12cee1373c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:43.532820 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-37a0c40b-04aa-4e54-b101-ce12cee1373c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:43.665918 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-37a0c40b-04aa-4e54-b101-ce12cee1373c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:43.669511 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:33:43.675017 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-37a0c40b-04aa-4e54-b101-ce12cee1373c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:43.676480 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-37a0c40b-04aa-4e54-b101-ce12cee1373c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:43.678184 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-37a0c40b-04aa-4e54-b101-ce12cee1373c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1721 microversion: 2.20 time: 0.158904 Sep 30 19:33:43.678735 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 268/559] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:33:43 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:33:44.329061 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [req-da0ca9f8-6218-4047-a8b0-e6c2ce8cdb35 req-80a5f6a1-6b57-4113-abab-dccfd3e929f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7a95413-7db3-443f-b375-3ddf2f3f6f1b", "name": "network-vif-plugged", "status": "completed", "tag": "7e028764-652a-4dc7-a348-c7dc9749c9b9"}]} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:33:44.334869 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell0:SELECT=6 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:33:44.341077 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-da0ca9f8-6218-4047-a8b0-e6c2ce8cdb35 req-80a5f6a1-6b57-4113-abab-dccfd3e929f6 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:44.341562 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-da0ca9f8-6218-4047-a8b0-e6c2ce8cdb35 req-80a5f6a1-6b57-4113-abab-dccfd3e929f6 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:44.341993 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-da0ca9f8-6218-4047-a8b0-e6c2ce8cdb35 req-80a5f6a1-6b57-4113-abab-dccfd3e929f6 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:44.353312 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-0d4e4a71-131a-4795-9177-599866dd892b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:33:44.353859 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.compute.server_external_events [req-da0ca9f8-6218-4047-a8b0-e6c2ce8cdb35 req-80a5f6a1-6b57-4113-abab-dccfd3e929f6 service nova] Creating event network-vif-plugged:7e028764-652a-4dc7-a348-c7dc9749c9b9 for instance e7a95413-7db3-443f-b375-3ddf2f3f6f1b on hv-cinder-86001 Sep 30 19:33:44.354019 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-0d4e4a71-131a-4795-9177-599866dd892b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: e7a95413-7db3-443f-b375-3ddf2f3f6f1b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:33:44.357785 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=2 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:33:44.358495 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=6 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:33:44.359818 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [req-da0ca9f8-6218-4047-a8b0-e6c2ce8cdb35 req-80a5f6a1-6b57-4113-abab-dccfd3e929f6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034384 Sep 30 19:33:44.361041 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 292/560] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 30 19:33:44.364736 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0d4e4a71-131a-4795-9177-599866dd892b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:44.365223 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0d4e4a71-131a-4795-9177-599866dd892b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:44.365655 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0d4e4a71-131a-4795-9177-599866dd892b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:44.366211 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-5b3b1e6d-745d-46b2-946a-55187ebe3e5d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:33:44.366326 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0d4e4a71-131a-4795-9177-599866dd892b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:44.366779 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0d4e4a71-131a-4795-9177-599866dd892b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:44.367200 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0d4e4a71-131a-4795-9177-599866dd892b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:44.367636 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-5b3b1e6d-745d-46b2-946a-55187ebe3e5d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:33:44.376337 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5b3b1e6d-745d-46b2-946a-55187ebe3e5d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:44.376888 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5b3b1e6d-745d-46b2-946a-55187ebe3e5d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:44.377348 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5b3b1e6d-745d-46b2-946a-55187ebe3e5d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:44.378064 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5b3b1e6d-745d-46b2-946a-55187ebe3e5d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:44.379234 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5b3b1e6d-745d-46b2-946a-55187ebe3e5d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:44.379672 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5b3b1e6d-745d-46b2-946a-55187ebe3e5d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:44.517837 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-0d4e4a71-131a-4795-9177-599866dd892b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:44.527665 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-0d4e4a71-131a-4795-9177-599866dd892b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/e7a95413-7db3-443f-b375-3ddf2f3f6f1b" status: 200 len: 1368 microversion: 2.1 time: 0.178696 Sep 30 19:33:44.528354 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 269/561] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:33:44 2022] GET /compute/v2.1/servers/e7a95413-7db3-443f-b375-3ddf2f3f6f1b => generated 1368 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:33:44.532013 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-5b3b1e6d-745d-46b2-946a-55187ebe3e5d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:44.542117 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-5b3b1e6d-745d-46b2-946a-55187ebe3e5d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1723 microversion: 2.1 time: 0.179874 Sep 30 19:33:44.542685 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 293/562] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:33:44 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:33:44.704270 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-791e858f-83bd-4c99-a5ad-40d7f8053551 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:33:44.705234 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-791e858f-83bd-4c99-a5ad-40d7f8053551 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:33:44.712895 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-791e858f-83bd-4c99-a5ad-40d7f8053551 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:44.713372 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-791e858f-83bd-4c99-a5ad-40d7f8053551 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:44.713805 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-791e858f-83bd-4c99-a5ad-40d7f8053551 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:44.714492 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-791e858f-83bd-4c99-a5ad-40d7f8053551 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:44.714953 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-791e858f-83bd-4c99-a5ad-40d7f8053551 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:44.715364 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-791e858f-83bd-4c99-a5ad-40d7f8053551 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:44.845279 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-791e858f-83bd-4c99-a5ad-40d7f8053551 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:44.854435 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-791e858f-83bd-4c99-a5ad-40d7f8053551 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:44.856672 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-791e858f-83bd-4c99-a5ad-40d7f8053551 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:44.858102 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-791e858f-83bd-4c99-a5ad-40d7f8053551 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1721 microversion: 2.20 time: 0.157838 Sep 30 19:33:44.858655 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 270/563] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:33:44 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:33:45.552876 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-0ebd920b-0f2f-461c-b0a3-6c3df913a276 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:33:45.553485 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-0ebd920b-0f2f-461c-b0a3-6c3df913a276 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: e7a95413-7db3-443f-b375-3ddf2f3f6f1b] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:33:45.560266 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0ebd920b-0f2f-461c-b0a3-6c3df913a276 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:45.560777 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0ebd920b-0f2f-461c-b0a3-6c3df913a276 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:45.561279 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0ebd920b-0f2f-461c-b0a3-6c3df913a276 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:45.562010 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0ebd920b-0f2f-461c-b0a3-6c3df913a276 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:45.562465 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0ebd920b-0f2f-461c-b0a3-6c3df913a276 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:45.562890 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0ebd920b-0f2f-461c-b0a3-6c3df913a276 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:45.565910 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-22c71f46-3410-417c-bb1c-5f1f124f5117 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:33:45.566524 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-22c71f46-3410-417c-bb1c-5f1f124f5117 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:33:45.573020 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-22c71f46-3410-417c-bb1c-5f1f124f5117 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:45.573508 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-22c71f46-3410-417c-bb1c-5f1f124f5117 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:45.573940 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-22c71f46-3410-417c-bb1c-5f1f124f5117 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:45.574660 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-22c71f46-3410-417c-bb1c-5f1f124f5117 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:45.575142 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-22c71f46-3410-417c-bb1c-5f1f124f5117 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:45.575567 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-22c71f46-3410-417c-bb1c-5f1f124f5117 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:45.694752 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-0ebd920b-0f2f-461c-b0a3-6c3df913a276 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:45.702361 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-0ebd920b-0f2f-461c-b0a3-6c3df913a276 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/e7a95413-7db3-443f-b375-3ddf2f3f6f1b" status: 200 len: 1368 microversion: 2.1 time: 0.153343 Sep 30 19:33:45.702934 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 294/564] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:33:45 2022] GET /compute/v2.1/servers/e7a95413-7db3-443f-b375-3ddf2f3f6f1b => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:33:45.707490 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-22c71f46-3410-417c-bb1c-5f1f124f5117 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:45.716583 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-22c71f46-3410-417c-bb1c-5f1f124f5117 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1723 microversion: 2.1 time: 0.154379 Sep 30 19:33:45.717139 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 271/565] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:33:45 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:33:45.883661 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-4e4434e4-e522-4475-a4a3-a4f8dd6c827c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:33:45.884298 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-4e4434e4-e522-4475-a4a3-a4f8dd6c827c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:33:45.890243 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4e4434e4-e522-4475-a4a3-a4f8dd6c827c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:45.890731 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4e4434e4-e522-4475-a4a3-a4f8dd6c827c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:45.891172 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4e4434e4-e522-4475-a4a3-a4f8dd6c827c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:45.891867 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4e4434e4-e522-4475-a4a3-a4f8dd6c827c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:45.892327 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4e4434e4-e522-4475-a4a3-a4f8dd6c827c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:45.892780 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4e4434e4-e522-4475-a4a3-a4f8dd6c827c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:46.020917 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-4e4434e4-e522-4475-a4a3-a4f8dd6c827c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:46.028883 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-4e4434e4-e522-4475-a4a3-a4f8dd6c827c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:46.030338 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-4e4434e4-e522-4475-a4a3-a4f8dd6c827c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:46.031504 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-4e4434e4-e522-4475-a4a3-a4f8dd6c827c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1721 microversion: 2.20 time: 0.152293 Sep 30 19:33:46.032056 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 295/566] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:33:45 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:33:46.727595 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-55c1dcc0-f5d3-4848-93ad-7d40fa591a46 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:33:46.728199 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-55c1dcc0-f5d3-4848-93ad-7d40fa591a46 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: e7a95413-7db3-443f-b375-3ddf2f3f6f1b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:33:46.734663 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-55c1dcc0-f5d3-4848-93ad-7d40fa591a46 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:46.735251 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-55c1dcc0-f5d3-4848-93ad-7d40fa591a46 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:46.735740 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-55c1dcc0-f5d3-4848-93ad-7d40fa591a46 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:46.736487 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-55c1dcc0-f5d3-4848-93ad-7d40fa591a46 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:46.736985 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-55c1dcc0-f5d3-4848-93ad-7d40fa591a46 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:46.737407 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-55c1dcc0-f5d3-4848-93ad-7d40fa591a46 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:46.741565 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-902c2fef-4224-4261-9c05-44698afde64a tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:33:46.742302 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-902c2fef-4224-4261-9c05-44698afde64a tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:33:46.748788 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-902c2fef-4224-4261-9c05-44698afde64a tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:46.749257 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-902c2fef-4224-4261-9c05-44698afde64a tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:46.749691 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-902c2fef-4224-4261-9c05-44698afde64a tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:46.750410 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-902c2fef-4224-4261-9c05-44698afde64a tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:46.750860 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-902c2fef-4224-4261-9c05-44698afde64a tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:46.751280 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-902c2fef-4224-4261-9c05-44698afde64a tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:46.882750 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-55c1dcc0-f5d3-4848-93ad-7d40fa591a46 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:46.884001 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-902c2fef-4224-4261-9c05-44698afde64a tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:46.890714 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-55c1dcc0-f5d3-4848-93ad-7d40fa591a46 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/e7a95413-7db3-443f-b375-3ddf2f3f6f1b" status: 200 len: 1368 microversion: 2.1 time: 0.168496 Sep 30 19:33:46.891282 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 272/567] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:33:46 2022] GET /compute/v2.1/servers/e7a95413-7db3-443f-b375-3ddf2f3f6f1b => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:33:46.892067 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-902c2fef-4224-4261-9c05-44698afde64a tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1723 microversion: 2.1 time: 0.154390 Sep 30 19:33:46.892828 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 296/568] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:33:46 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:33:47.057211 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-356c3fb1-1473-4142-a840-3cb117e601d2 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:33:47.057811 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-356c3fb1-1473-4142-a840-3cb117e601d2 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:33:47.063803 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-356c3fb1-1473-4142-a840-3cb117e601d2 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:47.064281 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-356c3fb1-1473-4142-a840-3cb117e601d2 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:47.064743 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-356c3fb1-1473-4142-a840-3cb117e601d2 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:47.065424 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-356c3fb1-1473-4142-a840-3cb117e601d2 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:47.065872 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-356c3fb1-1473-4142-a840-3cb117e601d2 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:47.066291 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-356c3fb1-1473-4142-a840-3cb117e601d2 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:47.191789 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-356c3fb1-1473-4142-a840-3cb117e601d2 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:47.199772 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-356c3fb1-1473-4142-a840-3cb117e601d2 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:47.201237 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-356c3fb1-1473-4142-a840-3cb117e601d2 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:47.202395 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-356c3fb1-1473-4142-a840-3cb117e601d2 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1721 microversion: 2.20 time: 0.149016 Sep 30 19:33:47.202946 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 273/569] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:33:47 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:33:47.913217 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-ca6e38c5-e70f-4c8a-8fd7-73e6331fa449 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:33:47.913811 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-ca6e38c5-e70f-4c8a-8fd7-73e6331fa449 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: e7a95413-7db3-443f-b375-3ddf2f3f6f1b] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:33:47.915028 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-9ffd2904-622e-45b2-b1fc-af3ffb50db76 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:33:47.915703 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-9ffd2904-622e-45b2-b1fc-af3ffb50db76 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:33:47.921537 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ca6e38c5-e70f-4c8a-8fd7-73e6331fa449 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:47.922025 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ca6e38c5-e70f-4c8a-8fd7-73e6331fa449 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:47.922206 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9ffd2904-622e-45b2-b1fc-af3ffb50db76 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:47.922456 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ca6e38c5-e70f-4c8a-8fd7-73e6331fa449 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:47.922684 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9ffd2904-622e-45b2-b1fc-af3ffb50db76 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:47.923112 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9ffd2904-622e-45b2-b1fc-af3ffb50db76 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:47.923210 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ca6e38c5-e70f-4c8a-8fd7-73e6331fa449 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:47.923577 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ca6e38c5-e70f-4c8a-8fd7-73e6331fa449 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:47.923794 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9ffd2904-622e-45b2-b1fc-af3ffb50db76 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:47.923996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ca6e38c5-e70f-4c8a-8fd7-73e6331fa449 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:47.924244 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9ffd2904-622e-45b2-b1fc-af3ffb50db76 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:47.924707 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9ffd2904-622e-45b2-b1fc-af3ffb50db76 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:48.057862 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-ca6e38c5-e70f-4c8a-8fd7-73e6331fa449 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:48.058332 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-9ffd2904-622e-45b2-b1fc-af3ffb50db76 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:48.065778 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-ca6e38c5-e70f-4c8a-8fd7-73e6331fa449 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/e7a95413-7db3-443f-b375-3ddf2f3f6f1b" status: 200 len: 1558 microversion: 2.1 time: 0.156752 Sep 30 19:33:48.066343 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 297/570] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:33:47 2022] GET /compute/v2.1/servers/e7a95413-7db3-443f-b375-3ddf2f3f6f1b => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:33:48.066598 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-9ffd2904-622e-45b2-b1fc-af3ffb50db76 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1723 microversion: 2.1 time: 0.155387 Sep 30 19:33:48.067157 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 274/571] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:33:47 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:33:48.088005 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-0b02cdae-b884-4b6a-8d20-bede18b25cc6 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:33:48.088548 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-0b02cdae-b884-4b6a-8d20-bede18b25cc6 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: e7a95413-7db3-443f-b375-3ddf2f3f6f1b] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:33:48.094173 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0b02cdae-b884-4b6a-8d20-bede18b25cc6 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:48.094648 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0b02cdae-b884-4b6a-8d20-bede18b25cc6 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:48.095077 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0b02cdae-b884-4b6a-8d20-bede18b25cc6 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:48.095753 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0b02cdae-b884-4b6a-8d20-bede18b25cc6 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:48.096208 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0b02cdae-b884-4b6a-8d20-bede18b25cc6 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:48.096655 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0b02cdae-b884-4b6a-8d20-bede18b25cc6 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:48.172675 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-0b02cdae-b884-4b6a-8d20-bede18b25cc6 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/e7a95413-7db3-443f-b375-3ddf2f3f6f1b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088202 Sep 30 19:33:48.173256 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 298/572] 10.222.0.17 () {58 vars in 1275 bytes} [Fri Sep 30 19:33:48 2022] GET /compute/v2.1/servers/e7a95413-7db3-443f-b375-3ddf2f3f6f1b/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 30 19:33:48.227549 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-fee5860c-6758-43ce-b260-06f2941559af tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:33:48.228162 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-fee5860c-6758-43ce-b260-06f2941559af tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:33:48.234103 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fee5860c-6758-43ce-b260-06f2941559af tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:48.234589 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fee5860c-6758-43ce-b260-06f2941559af tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:48.235026 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fee5860c-6758-43ce-b260-06f2941559af tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:48.235753 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fee5860c-6758-43ce-b260-06f2941559af tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:48.236200 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fee5860c-6758-43ce-b260-06f2941559af tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:48.236654 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fee5860c-6758-43ce-b260-06f2941559af tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:48.373420 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-fee5860c-6758-43ce-b260-06f2941559af tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:48.382630 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-fee5860c-6758-43ce-b260-06f2941559af tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:48.388221 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-fee5860c-6758-43ce-b260-06f2941559af tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:48.388221 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-fee5860c-6758-43ce-b260-06f2941559af tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1721 microversion: 2.20 time: 0.162421 Sep 30 19:33:48.388221 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 275/573] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:33:48 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:33:49.090516 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-92ee7da7-2e2e-4ce2-9057-a7776c5d3138 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:33:49.091207 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-92ee7da7-2e2e-4ce2-9057-a7776c5d3138 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:33:49.097257 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-92ee7da7-2e2e-4ce2-9057-a7776c5d3138 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:49.097737 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-92ee7da7-2e2e-4ce2-9057-a7776c5d3138 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:49.098172 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-92ee7da7-2e2e-4ce2-9057-a7776c5d3138 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:49.099473 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-92ee7da7-2e2e-4ce2-9057-a7776c5d3138 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:49.099925 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-92ee7da7-2e2e-4ce2-9057-a7776c5d3138 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:49.100348 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-92ee7da7-2e2e-4ce2-9057-a7776c5d3138 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:49.284709 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-92ee7da7-2e2e-4ce2-9057-a7776c5d3138 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:49.292834 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-92ee7da7-2e2e-4ce2-9057-a7776c5d3138 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1723 microversion: 2.1 time: 0.206776 Sep 30 19:33:49.293713 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 299/574] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:33:49 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:33:49.411197 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-dcae962c-0340-4074-917c-07b76368ef08 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:33:49.411812 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-dcae962c-0340-4074-917c-07b76368ef08 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:33:49.424629 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [req-0afe595a-acb5-470b-9459-e0edd583d691 req-6f4f0dae-ead5-4e49-b281-3fa91b6651c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7a95413-7db3-443f-b375-3ddf2f3f6f1b", "tag": "7e028764-652a-4dc7-a348-c7dc9749c9b9"}]} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:33:49.425503 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-dcae962c-0340-4074-917c-07b76368ef08 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:49.426005 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-dcae962c-0340-4074-917c-07b76368ef08 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:49.426589 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-dcae962c-0340-4074-917c-07b76368ef08 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:49.427443 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-dcae962c-0340-4074-917c-07b76368ef08 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:49.427907 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-dcae962c-0340-4074-917c-07b76368ef08 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:49.428326 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-dcae962c-0340-4074-917c-07b76368ef08 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:49.434506 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-0afe595a-acb5-470b-9459-e0edd583d691 req-6f4f0dae-ead5-4e49-b281-3fa91b6651c3 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:49.435251 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-0afe595a-acb5-470b-9459-e0edd583d691 req-6f4f0dae-ead5-4e49-b281-3fa91b6651c3 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:49.435939 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-0afe595a-acb5-470b-9459-e0edd583d691 req-6f4f0dae-ead5-4e49-b281-3fa91b6651c3 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:49.448117 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.compute.server_external_events [req-0afe595a-acb5-470b-9459-e0edd583d691 req-6f4f0dae-ead5-4e49-b281-3fa91b6651c3 service nova] Creating event network-changed:7e028764-652a-4dc7-a348-c7dc9749c9b9 for instance e7a95413-7db3-443f-b375-3ddf2f3f6f1b on hv-cinder-86001 Sep 30 19:33:49.453574 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [req-0afe595a-acb5-470b-9459-e0edd583d691 req-6f4f0dae-ead5-4e49-b281-3fa91b6651c3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032537 Sep 30 19:33:49.454812 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 300/575] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 30 19:33:49.618055 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-dcae962c-0340-4074-917c-07b76368ef08 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:49.626619 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-dcae962c-0340-4074-917c-07b76368ef08 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:49.628117 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-dcae962c-0340-4074-917c-07b76368ef08 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:49.630672 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-dcae962c-0340-4074-917c-07b76368ef08 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1721 microversion: 2.20 time: 0.222925 Sep 30 19:33:49.640756 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 276/576] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:33:49 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1721 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:33:50.316048 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-03c9ef5e-a797-4bd2-8808-1e94ffd65497 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:33:50.316872 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-03c9ef5e-a797-4bd2-8808-1e94ffd65497 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:33:50.323821 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-03c9ef5e-a797-4bd2-8808-1e94ffd65497 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:50.324406 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-03c9ef5e-a797-4bd2-8808-1e94ffd65497 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:50.324847 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-03c9ef5e-a797-4bd2-8808-1e94ffd65497 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:50.325538 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-03c9ef5e-a797-4bd2-8808-1e94ffd65497 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:50.325989 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-03c9ef5e-a797-4bd2-8808-1e94ffd65497 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:50.326410 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-03c9ef5e-a797-4bd2-8808-1e94ffd65497 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:50.464488 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-03c9ef5e-a797-4bd2-8808-1e94ffd65497 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:50.472755 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-03c9ef5e-a797-4bd2-8808-1e94ffd65497 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1723 microversion: 2.1 time: 0.161369 Sep 30 19:33:50.473320 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 301/577] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:33:50 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:33:50.655082 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-15ea10b1-6825-43df-bc52-ff49aba0c5a0 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:33:50.655687 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-15ea10b1-6825-43df-bc52-ff49aba0c5a0 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:33:50.662609 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-15ea10b1-6825-43df-bc52-ff49aba0c5a0 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:50.663125 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-15ea10b1-6825-43df-bc52-ff49aba0c5a0 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:50.663562 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-15ea10b1-6825-43df-bc52-ff49aba0c5a0 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:50.664253 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-15ea10b1-6825-43df-bc52-ff49aba0c5a0 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:50.664762 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-15ea10b1-6825-43df-bc52-ff49aba0c5a0 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:50.665187 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-15ea10b1-6825-43df-bc52-ff49aba0c5a0 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:50.792593 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-15ea10b1-6825-43df-bc52-ff49aba0c5a0 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:50.802941 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-15ea10b1-6825-43df-bc52-ff49aba0c5a0 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:50.805147 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-15ea10b1-6825-43df-bc52-ff49aba0c5a0 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:50.806309 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-15ea10b1-6825-43df-bc52-ff49aba0c5a0 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1721 microversion: 2.20 time: 0.155196 Sep 30 19:33:50.806861 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 277/578] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:33:50 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:33:51.495079 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-c386b323-24b8-494f-95a7-ea87f550607b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:33:51.495686 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-c386b323-24b8-494f-95a7-ea87f550607b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:33:51.502072 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c386b323-24b8-494f-95a7-ea87f550607b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:51.502554 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c386b323-24b8-494f-95a7-ea87f550607b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:51.502992 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c386b323-24b8-494f-95a7-ea87f550607b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:51.503688 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c386b323-24b8-494f-95a7-ea87f550607b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:51.504145 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c386b323-24b8-494f-95a7-ea87f550607b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:51.504605 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c386b323-24b8-494f-95a7-ea87f550607b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:51.639151 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-c386b323-24b8-494f-95a7-ea87f550607b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:51.642691 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell1:SELECT=100 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:33:51.649163 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-c386b323-24b8-494f-95a7-ea87f550607b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1723 microversion: 2.1 time: 0.157994 Sep 30 19:33:51.649723 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 302/579] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:33:51 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:33:51.830940 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-0328bc21-0ef8-44eb-90c5-1f21d9b597bb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:33:51.831541 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-0328bc21-0ef8-44eb-90c5-1f21d9b597bb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:33:51.833892 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:33:51.839533 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0328bc21-0ef8-44eb-90c5-1f21d9b597bb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:51.840010 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0328bc21-0ef8-44eb-90c5-1f21d9b597bb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:51.840468 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0328bc21-0ef8-44eb-90c5-1f21d9b597bb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:51.841156 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0328bc21-0ef8-44eb-90c5-1f21d9b597bb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:51.841601 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0328bc21-0ef8-44eb-90c5-1f21d9b597bb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:51.842018 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0328bc21-0ef8-44eb-90c5-1f21d9b597bb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:51.969736 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-0328bc21-0ef8-44eb-90c5-1f21d9b597bb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:51.977696 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-0328bc21-0ef8-44eb-90c5-1f21d9b597bb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:51.979123 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-0328bc21-0ef8-44eb-90c5-1f21d9b597bb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:51.980272 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-0328bc21-0ef8-44eb-90c5-1f21d9b597bb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1721 microversion: 2.20 time: 0.153271 Sep 30 19:33:51.980916 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 278/580] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:33:51 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:33:52.672970 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-443a9432-3725-4e09-8272-ec254a58c710 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:33:52.673511 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-443a9432-3725-4e09-8272-ec254a58c710 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:33:52.679851 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-443a9432-3725-4e09-8272-ec254a58c710 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:52.680339 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-443a9432-3725-4e09-8272-ec254a58c710 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:52.680819 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-443a9432-3725-4e09-8272-ec254a58c710 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:52.681519 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-443a9432-3725-4e09-8272-ec254a58c710 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:52.681983 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-443a9432-3725-4e09-8272-ec254a58c710 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:52.682414 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-443a9432-3725-4e09-8272-ec254a58c710 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:52.809468 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-443a9432-3725-4e09-8272-ec254a58c710 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:52.817855 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-443a9432-3725-4e09-8272-ec254a58c710 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1723 microversion: 2.1 time: 0.149060 Sep 30 19:33:52.818424 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 303/581] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:33:52 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:33:53.006252 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-606b4a06-e04b-497e-a34f-54be98fef94f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:33:53.006860 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-606b4a06-e04b-497e-a34f-54be98fef94f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:33:53.013236 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-606b4a06-e04b-497e-a34f-54be98fef94f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:53.013706 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-606b4a06-e04b-497e-a34f-54be98fef94f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:53.014131 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-606b4a06-e04b-497e-a34f-54be98fef94f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:53.014804 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-606b4a06-e04b-497e-a34f-54be98fef94f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:53.015248 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-606b4a06-e04b-497e-a34f-54be98fef94f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:53.015696 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-606b4a06-e04b-497e-a34f-54be98fef94f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:53.143941 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-606b4a06-e04b-497e-a34f-54be98fef94f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:53.152345 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-606b4a06-e04b-497e-a34f-54be98fef94f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:53.153796 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-606b4a06-e04b-497e-a34f-54be98fef94f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:53.154949 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-606b4a06-e04b-497e-a34f-54be98fef94f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1721 microversion: 2.20 time: 0.153074 Sep 30 19:33:53.155496 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 279/582] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:33:53 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:33:53.842063 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-ad6245b6-c9e3-48fe-84e9-e0a1ff55f521 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:33:53.842674 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-ad6245b6-c9e3-48fe-84e9-e0a1ff55f521 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:33:53.849553 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ad6245b6-c9e3-48fe-84e9-e0a1ff55f521 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:53.850037 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ad6245b6-c9e3-48fe-84e9-e0a1ff55f521 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:53.850477 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ad6245b6-c9e3-48fe-84e9-e0a1ff55f521 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:53.851167 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ad6245b6-c9e3-48fe-84e9-e0a1ff55f521 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:53.851622 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ad6245b6-c9e3-48fe-84e9-e0a1ff55f521 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:53.852050 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ad6245b6-c9e3-48fe-84e9-e0a1ff55f521 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:53.981429 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-ad6245b6-c9e3-48fe-84e9-e0a1ff55f521 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:53.990123 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-ad6245b6-c9e3-48fe-84e9-e0a1ff55f521 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1723 microversion: 2.1 time: 0.151255 Sep 30 19:33:53.990684 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 304/583] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:33:53 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:33:54.179901 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e3dcae5b-3225-44a5-8ffe-d2653d7e7dd9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:33:54.180444 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-e3dcae5b-3225-44a5-8ffe-d2653d7e7dd9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:33:54.186522 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e3dcae5b-3225-44a5-8ffe-d2653d7e7dd9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:54.186992 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e3dcae5b-3225-44a5-8ffe-d2653d7e7dd9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:54.187423 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e3dcae5b-3225-44a5-8ffe-d2653d7e7dd9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:54.188097 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e3dcae5b-3225-44a5-8ffe-d2653d7e7dd9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:54.188582 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e3dcae5b-3225-44a5-8ffe-d2653d7e7dd9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:54.189001 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e3dcae5b-3225-44a5-8ffe-d2653d7e7dd9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:54.314878 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-e3dcae5b-3225-44a5-8ffe-d2653d7e7dd9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:54.322717 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-e3dcae5b-3225-44a5-8ffe-d2653d7e7dd9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:54.324147 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-e3dcae5b-3225-44a5-8ffe-d2653d7e7dd9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:54.325327 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-e3dcae5b-3225-44a5-8ffe-d2653d7e7dd9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1721 microversion: 2.20 time: 0.149378 Sep 30 19:33:54.325883 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 280/584] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:33:54 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:33:55.013266 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-a980e8ff-dade-40c3-a063-a0dca5c24ce5 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:33:55.014847 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-a980e8ff-dade-40c3-a063-a0dca5c24ce5 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:33:55.016970 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=1 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:33:55.022100 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a980e8ff-dade-40c3-a063-a0dca5c24ce5 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:55.022584 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a980e8ff-dade-40c3-a063-a0dca5c24ce5 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:55.023022 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a980e8ff-dade-40c3-a063-a0dca5c24ce5 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:55.023710 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a980e8ff-dade-40c3-a063-a0dca5c24ce5 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:55.024163 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a980e8ff-dade-40c3-a063-a0dca5c24ce5 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:55.024617 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a980e8ff-dade-40c3-a063-a0dca5c24ce5 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:55.150353 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-a980e8ff-dade-40c3-a063-a0dca5c24ce5 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:55.159508 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-a980e8ff-dade-40c3-a063-a0dca5c24ce5 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1723 microversion: 2.1 time: 0.149863 Sep 30 19:33:55.160091 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 305/585] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:33:55 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:33:55.350995 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-1fc20a18-5c78-4434-8675-b2caaab01e9a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:33:55.351506 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-1fc20a18-5c78-4434-8675-b2caaab01e9a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:33:55.358185 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1fc20a18-5c78-4434-8675-b2caaab01e9a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:55.358669 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1fc20a18-5c78-4434-8675-b2caaab01e9a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:55.359105 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1fc20a18-5c78-4434-8675-b2caaab01e9a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:55.359794 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1fc20a18-5c78-4434-8675-b2caaab01e9a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:55.360250 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1fc20a18-5c78-4434-8675-b2caaab01e9a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:55.360714 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1fc20a18-5c78-4434-8675-b2caaab01e9a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:55.490724 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-1fc20a18-5c78-4434-8675-b2caaab01e9a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:55.498718 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-1fc20a18-5c78-4434-8675-b2caaab01e9a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:55.500162 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-1fc20a18-5c78-4434-8675-b2caaab01e9a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:55.501370 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-1fc20a18-5c78-4434-8675-b2caaab01e9a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1721 microversion: 2.20 time: 0.154818 Sep 30 19:33:55.501923 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 281/586] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:33:55 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:33:56.182799 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-984aa674-87f8-41f7-b97d-b223509dd8ee tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:33:56.183507 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-984aa674-87f8-41f7-b97d-b223509dd8ee tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:33:56.189868 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-984aa674-87f8-41f7-b97d-b223509dd8ee tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:56.190349 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-984aa674-87f8-41f7-b97d-b223509dd8ee tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:56.190784 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-984aa674-87f8-41f7-b97d-b223509dd8ee tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:56.191467 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-984aa674-87f8-41f7-b97d-b223509dd8ee tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:56.191919 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-984aa674-87f8-41f7-b97d-b223509dd8ee tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:56.192929 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-984aa674-87f8-41f7-b97d-b223509dd8ee tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:56.320234 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-984aa674-87f8-41f7-b97d-b223509dd8ee tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:56.328487 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-984aa674-87f8-41f7-b97d-b223509dd8ee tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1723 microversion: 2.1 time: 0.149540 Sep 30 19:33:56.329054 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 306/587] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:33:56 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:33:56.526509 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-0232acef-0903-4faf-835a-981661d120eb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:33:56.527119 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-0232acef-0903-4faf-835a-981661d120eb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:33:56.533500 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0232acef-0903-4faf-835a-981661d120eb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:56.533999 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0232acef-0903-4faf-835a-981661d120eb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:56.534687 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0232acef-0903-4faf-835a-981661d120eb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:56.535376 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0232acef-0903-4faf-835a-981661d120eb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:56.535834 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0232acef-0903-4faf-835a-981661d120eb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:56.536264 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0232acef-0903-4faf-835a-981661d120eb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:56.661969 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-0232acef-0903-4faf-835a-981661d120eb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:56.670595 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-0232acef-0903-4faf-835a-981661d120eb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:56.672115 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-0232acef-0903-4faf-835a-981661d120eb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:56.673341 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-0232acef-0903-4faf-835a-981661d120eb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1721 microversion: 2.20 time: 0.150723 Sep 30 19:33:56.673901 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 282/588] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:33:56 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:33:57.351766 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-3fc61f2a-ab53-41d5-a648-3dd03b7808df tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:33:57.352299 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-3fc61f2a-ab53-41d5-a648-3dd03b7808df tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:33:57.358840 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3fc61f2a-ab53-41d5-a648-3dd03b7808df tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:57.359328 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3fc61f2a-ab53-41d5-a648-3dd03b7808df tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:57.359770 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3fc61f2a-ab53-41d5-a648-3dd03b7808df tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:57.360498 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3fc61f2a-ab53-41d5-a648-3dd03b7808df tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:57.360960 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3fc61f2a-ab53-41d5-a648-3dd03b7808df tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:57.361391 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3fc61f2a-ab53-41d5-a648-3dd03b7808df tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:57.492165 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-3fc61f2a-ab53-41d5-a648-3dd03b7808df tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:57.500285 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-3fc61f2a-ab53-41d5-a648-3dd03b7808df tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1723 microversion: 2.1 time: 0.153050 Sep 30 19:33:57.500884 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 307/589] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:33:57 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:33:57.699447 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-2e589afb-c5e6-44e3-916f-2888ec9565e9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:33:57.700052 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-2e589afb-c5e6-44e3-916f-2888ec9565e9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:33:57.706726 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2e589afb-c5e6-44e3-916f-2888ec9565e9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:57.707205 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2e589afb-c5e6-44e3-916f-2888ec9565e9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:57.707670 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2e589afb-c5e6-44e3-916f-2888ec9565e9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:57.708352 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2e589afb-c5e6-44e3-916f-2888ec9565e9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:57.708837 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2e589afb-c5e6-44e3-916f-2888ec9565e9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:57.709257 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2e589afb-c5e6-44e3-916f-2888ec9565e9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:57.834473 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-2e589afb-c5e6-44e3-916f-2888ec9565e9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:57.842418 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-2e589afb-c5e6-44e3-916f-2888ec9565e9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:57.843858 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-2e589afb-c5e6-44e3-916f-2888ec9565e9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:57.845041 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-2e589afb-c5e6-44e3-916f-2888ec9565e9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1721 microversion: 2.20 time: 0.149437 Sep 30 19:33:57.845604 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 283/590] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:33:57 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:33:58.524619 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-d8ff58f2-5ab0-4650-9559-017cedb98685 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:33:58.525264 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-d8ff58f2-5ab0-4650-9559-017cedb98685 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:33:58.531663 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d8ff58f2-5ab0-4650-9559-017cedb98685 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:58.532150 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d8ff58f2-5ab0-4650-9559-017cedb98685 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:58.532641 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d8ff58f2-5ab0-4650-9559-017cedb98685 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:58.533338 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d8ff58f2-5ab0-4650-9559-017cedb98685 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:58.533800 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d8ff58f2-5ab0-4650-9559-017cedb98685 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:58.534492 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d8ff58f2-5ab0-4650-9559-017cedb98685 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:58.660627 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-d8ff58f2-5ab0-4650-9559-017cedb98685 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:58.669200 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-d8ff58f2-5ab0-4650-9559-017cedb98685 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1723 microversion: 2.1 time: 0.148957 Sep 30 19:33:58.669758 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 308/591] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:33:58 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:33:58.870335 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-96da60fc-d808-42c5-99c4-f8356d215c9b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:33:58.870968 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-96da60fc-d808-42c5-99c4-f8356d215c9b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:33:58.877377 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-96da60fc-d808-42c5-99c4-f8356d215c9b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:58.877852 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-96da60fc-d808-42c5-99c4-f8356d215c9b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:58.878285 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-96da60fc-d808-42c5-99c4-f8356d215c9b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:58.878971 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-96da60fc-d808-42c5-99c4-f8356d215c9b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:58.879419 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-96da60fc-d808-42c5-99c4-f8356d215c9b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:58.879837 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-96da60fc-d808-42c5-99c4-f8356d215c9b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:59.008403 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-96da60fc-d808-42c5-99c4-f8356d215c9b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:59.016340 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-96da60fc-d808-42c5-99c4-f8356d215c9b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:59.017819 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-96da60fc-d808-42c5-99c4-f8356d215c9b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:59.018962 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-96da60fc-d808-42c5-99c4-f8356d215c9b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1742 microversion: 2.20 time: 0.152490 Sep 30 19:33:59.019510 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 284/592] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:33:58 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1742 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:33:59.692210 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-c7174d97-896d-48b0-8665-908be194bdf9 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:33:59.692832 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-c7174d97-896d-48b0-8665-908be194bdf9 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:33:59.699203 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c7174d97-896d-48b0-8665-908be194bdf9 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:59.699684 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c7174d97-896d-48b0-8665-908be194bdf9 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:59.700113 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c7174d97-896d-48b0-8665-908be194bdf9 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:59.700830 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c7174d97-896d-48b0-8665-908be194bdf9 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:59.701282 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c7174d97-896d-48b0-8665-908be194bdf9 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:59.701724 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c7174d97-896d-48b0-8665-908be194bdf9 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:59.832509 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-c7174d97-896d-48b0-8665-908be194bdf9 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:33:59.840715 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-c7174d97-896d-48b0-8665-908be194bdf9 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1700 microversion: 2.1 time: 0.152448 Sep 30 19:33:59.841276 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 309/593] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:33:59 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1700 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:33:59.863292 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-7a3164e5-9c9f-4d6e-a166-38809c1e48f8 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:33:59.869852 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7a3164e5-9c9f-4d6e-a166-38809c1e48f8 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:59.870339 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7a3164e5-9c9f-4d6e-a166-38809c1e48f8 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:59.870780 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7a3164e5-9c9f-4d6e-a166-38809c1e48f8 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:59.887548 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=100 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:33:59.894223 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-7a3164e5-9c9f-4d6e-a166-38809c1e48f8 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Going to try to start instance {{(pid=120648) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 30 19:33:59.937010 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-7a3164e5-9c9f-4d6e-a166-38809c1e48f8 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "POST /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9/action" status: 202 len: 0 microversion: 2.1 time: 0.077443 Sep 30 19:33:59.937658 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 285/594] 10.222.0.17 () {60 vars in 1278 bytes} [Fri Sep 30 19:33:59 2022] POST /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 30 19:33:59.946333 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-d1168803-f596-4a5d-9091-b6cef65dd4c8 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:33:59.946879 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-d1168803-f596-4a5d-9091-b6cef65dd4c8 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:33:59.953302 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d1168803-f596-4a5d-9091-b6cef65dd4c8 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:59.953915 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d1168803-f596-4a5d-9091-b6cef65dd4c8 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:59.954412 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d1168803-f596-4a5d-9091-b6cef65dd4c8 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:33:59.955120 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d1168803-f596-4a5d-9091-b6cef65dd4c8 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:33:59.955612 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d1168803-f596-4a5d-9091-b6cef65dd4c8 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:33:59.956079 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d1168803-f596-4a5d-9091-b6cef65dd4c8 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:00.045611 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-95fa94a7-a469-479b-9d10-734fa46af2ee tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:34:00.046308 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-95fa94a7-a469-479b-9d10-734fa46af2ee tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:34:00.053938 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-95fa94a7-a469-479b-9d10-734fa46af2ee tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:00.054430 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-95fa94a7-a469-479b-9d10-734fa46af2ee tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:00.054869 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-95fa94a7-a469-479b-9d10-734fa46af2ee tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:00.055647 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-95fa94a7-a469-479b-9d10-734fa46af2ee tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:00.056038 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-95fa94a7-a469-479b-9d10-734fa46af2ee tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:00.056498 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-95fa94a7-a469-479b-9d10-734fa46af2ee tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:00.258811 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-d1168803-f596-4a5d-9091-b6cef65dd4c8 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:00.264201 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-95fa94a7-a469-479b-9d10-734fa46af2ee tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:00.271277 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-d1168803-f596-4a5d-9091-b6cef65dd4c8 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1709 microversion: 2.1 time: 0.329294 Sep 30 19:34:00.272990 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 310/595] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:33:59 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1709 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:34:00.275333 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-95fa94a7-a469-479b-9d10-734fa46af2ee tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:00.276880 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-95fa94a7-a469-479b-9d10-734fa46af2ee tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:00.278045 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-95fa94a7-a469-479b-9d10-734fa46af2ee tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1742 microversion: 2.20 time: 0.237211 Sep 30 19:34:00.278596 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 286/596] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:34:00 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1742 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:34:01.296111 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-8527557f-a9a9-40cc-a4a4-18663b77aa74 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:34:01.296678 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-8527557f-a9a9-40cc-a4a4-18663b77aa74 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:34:01.303996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8527557f-a9a9-40cc-a4a4-18663b77aa74 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:01.304519 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8527557f-a9a9-40cc-a4a4-18663b77aa74 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:01.304958 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8527557f-a9a9-40cc-a4a4-18663b77aa74 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:01.305529 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-5eb475b2-cd46-44e4-93d7-2aab4532f6c8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:34:01.305926 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8527557f-a9a9-40cc-a4a4-18663b77aa74 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:01.306125 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-5eb475b2-cd46-44e4-93d7-2aab4532f6c8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:34:01.306250 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8527557f-a9a9-40cc-a4a4-18663b77aa74 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:01.306622 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8527557f-a9a9-40cc-a4a4-18663b77aa74 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:01.312314 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5eb475b2-cd46-44e4-93d7-2aab4532f6c8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:01.312816 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5eb475b2-cd46-44e4-93d7-2aab4532f6c8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:01.313248 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5eb475b2-cd46-44e4-93d7-2aab4532f6c8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:01.313930 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5eb475b2-cd46-44e4-93d7-2aab4532f6c8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:01.314379 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5eb475b2-cd46-44e4-93d7-2aab4532f6c8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:01.314800 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5eb475b2-cd46-44e4-93d7-2aab4532f6c8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:01.440391 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-8527557f-a9a9-40cc-a4a4-18663b77aa74 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:01.449383 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-8527557f-a9a9-40cc-a4a4-18663b77aa74 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1709 microversion: 2.1 time: 0.157207 Sep 30 19:34:01.449961 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 311/597] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:34:01 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1709 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:34:01.501221 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-5eb475b2-cd46-44e4-93d7-2aab4532f6c8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:01.509901 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-5eb475b2-cd46-44e4-93d7-2aab4532f6c8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:01.511378 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-5eb475b2-cd46-44e4-93d7-2aab4532f6c8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:01.512630 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-5eb475b2-cd46-44e4-93d7-2aab4532f6c8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1742 microversion: 2.20 time: 0.211408 Sep 30 19:34:01.513230 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 287/598] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:34:01 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1742 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:34:02.405689 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [req-030dbfbf-9d31-41f5-8105-ef4f23fac420 req-d7d59cf5-21ab-4021-9ee7-7e7d87a62ba8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c87cf7d2-5d47-474b-b2f0-1ddc37bc97df", "name": "network-vif-plugged", "status": "completed", "tag": "408315e4-bcde-4577-8c32-5d47d233c194"}]} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:34:02.417796 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-030dbfbf-9d31-41f5-8105-ef4f23fac420 req-d7d59cf5-21ab-4021-9ee7-7e7d87a62ba8 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:02.418551 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-030dbfbf-9d31-41f5-8105-ef4f23fac420 req-d7d59cf5-21ab-4021-9ee7-7e7d87a62ba8 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:02.419053 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-030dbfbf-9d31-41f5-8105-ef4f23fac420 req-d7d59cf5-21ab-4021-9ee7-7e7d87a62ba8 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:02.430255 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.compute.server_external_events [req-030dbfbf-9d31-41f5-8105-ef4f23fac420 req-d7d59cf5-21ab-4021-9ee7-7e7d87a62ba8 service nova] Creating event network-vif-plugged:408315e4-bcde-4577-8c32-5d47d233c194 for instance c87cf7d2-5d47-474b-b2f0-1ddc37bc97df on hv-cinder-86001 Sep 30 19:34:02.435230 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [req-030dbfbf-9d31-41f5-8105-ef4f23fac420 req-d7d59cf5-21ab-4021-9ee7-7e7d87a62ba8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033641 Sep 30 19:34:02.436198 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 312/599] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:34:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:34:02.472731 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-c077bf60-8de1-41c9-b5e3-693557e6bd5e tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:34:02.473324 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-c077bf60-8de1-41c9-b5e3-693557e6bd5e tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:34:02.479763 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c077bf60-8de1-41c9-b5e3-693557e6bd5e tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:02.480237 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c077bf60-8de1-41c9-b5e3-693557e6bd5e tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:02.480697 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c077bf60-8de1-41c9-b5e3-693557e6bd5e tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:02.481378 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c077bf60-8de1-41c9-b5e3-693557e6bd5e tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:02.481826 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c077bf60-8de1-41c9-b5e3-693557e6bd5e tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:02.482245 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c077bf60-8de1-41c9-b5e3-693557e6bd5e tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:02.539801 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-45afe937-b036-451b-89b7-d78ada75dfad tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:34:02.540428 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-45afe937-b036-451b-89b7-d78ada75dfad tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:34:02.546495 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-45afe937-b036-451b-89b7-d78ada75dfad tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:02.546979 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-45afe937-b036-451b-89b7-d78ada75dfad tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:02.547418 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-45afe937-b036-451b-89b7-d78ada75dfad tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:02.548112 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-45afe937-b036-451b-89b7-d78ada75dfad tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:02.548592 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-45afe937-b036-451b-89b7-d78ada75dfad tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:02.549021 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-45afe937-b036-451b-89b7-d78ada75dfad tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:02.609819 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-c077bf60-8de1-41c9-b5e3-693557e6bd5e tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:02.618536 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-c077bf60-8de1-41c9-b5e3-693557e6bd5e tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1713 microversion: 2.1 time: 0.149750 Sep 30 19:34:02.619100 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 288/600] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:34:02 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1713 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:34:02.677380 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-45afe937-b036-451b-89b7-d78ada75dfad tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:02.686434 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-45afe937-b036-451b-89b7-d78ada75dfad tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:02.687876 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-45afe937-b036-451b-89b7-d78ada75dfad tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:02.689076 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-45afe937-b036-451b-89b7-d78ada75dfad tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1742 microversion: 2.20 time: 0.153655 Sep 30 19:34:02.689638 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 313/601] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:34:02 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1742 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:34:03.714523 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-2ff23c93-a944-408e-a598-a3588a1c538c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:34:03.715124 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-2ff23c93-a944-408e-a598-a3588a1c538c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:34:03.721823 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2ff23c93-a944-408e-a598-a3588a1c538c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:03.722301 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2ff23c93-a944-408e-a598-a3588a1c538c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:03.722723 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2ff23c93-a944-408e-a598-a3588a1c538c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:03.723412 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2ff23c93-a944-408e-a598-a3588a1c538c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:03.723858 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2ff23c93-a944-408e-a598-a3588a1c538c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:03.724279 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2ff23c93-a944-408e-a598-a3588a1c538c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:03.851095 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-2ff23c93-a944-408e-a598-a3588a1c538c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:03.859095 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-2ff23c93-a944-408e-a598-a3588a1c538c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:03.860549 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-2ff23c93-a944-408e-a598-a3588a1c538c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:03.861698 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-2ff23c93-a944-408e-a598-a3588a1c538c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1742 microversion: 2.20 time: 0.151077 Sep 30 19:34:03.862249 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 289/602] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:34:03 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1742 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:34:04.886998 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-bf7ff6b4-4722-4e05-9640-f07ca273f8cb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:34:04.887605 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-bf7ff6b4-4722-4e05-9640-f07ca273f8cb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:34:04.893960 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-bf7ff6b4-4722-4e05-9640-f07ca273f8cb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:04.894444 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-bf7ff6b4-4722-4e05-9640-f07ca273f8cb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:04.894875 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-bf7ff6b4-4722-4e05-9640-f07ca273f8cb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:04.895563 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-bf7ff6b4-4722-4e05-9640-f07ca273f8cb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:04.896017 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-bf7ff6b4-4722-4e05-9640-f07ca273f8cb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:04.896472 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-bf7ff6b4-4722-4e05-9640-f07ca273f8cb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:05.024452 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-bf7ff6b4-4722-4e05-9640-f07ca273f8cb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:05.032392 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-bf7ff6b4-4722-4e05-9640-f07ca273f8cb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:05.033823 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-bf7ff6b4-4722-4e05-9640-f07ca273f8cb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:05.035242 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-bf7ff6b4-4722-4e05-9640-f07ca273f8cb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1742 microversion: 2.20 time: 0.152205 Sep 30 19:34:05.035793 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 314/603] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:34:04 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1742 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:34:06.060044 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-6eb59d03-1190-4fab-ba58-8d1aaf4e7fac tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:34:06.060671 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-6eb59d03-1190-4fab-ba58-8d1aaf4e7fac tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:34:06.067617 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6eb59d03-1190-4fab-ba58-8d1aaf4e7fac tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:06.068093 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6eb59d03-1190-4fab-ba58-8d1aaf4e7fac tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:06.068622 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6eb59d03-1190-4fab-ba58-8d1aaf4e7fac tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:06.069310 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6eb59d03-1190-4fab-ba58-8d1aaf4e7fac tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:06.069755 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6eb59d03-1190-4fab-ba58-8d1aaf4e7fac tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:06.070178 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6eb59d03-1190-4fab-ba58-8d1aaf4e7fac tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:06.197940 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-6eb59d03-1190-4fab-ba58-8d1aaf4e7fac tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:06.206497 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-6eb59d03-1190-4fab-ba58-8d1aaf4e7fac tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:06.208012 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-6eb59d03-1190-4fab-ba58-8d1aaf4e7fac tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:06.209793 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-6eb59d03-1190-4fab-ba58-8d1aaf4e7fac tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1742 microversion: 2.20 time: 0.153059 Sep 30 19:34:06.210437 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 290/604] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:34:06 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1742 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:34:07.236525 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-f79626b6-7ced-4e22-8892-e7c90984d4d1 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:34:07.239057 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-f79626b6-7ced-4e22-8892-e7c90984d4d1 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:34:07.247245 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f79626b6-7ced-4e22-8892-e7c90984d4d1 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:07.249229 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f79626b6-7ced-4e22-8892-e7c90984d4d1 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:07.250636 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f79626b6-7ced-4e22-8892-e7c90984d4d1 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:07.251501 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f79626b6-7ced-4e22-8892-e7c90984d4d1 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:07.251982 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f79626b6-7ced-4e22-8892-e7c90984d4d1 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:07.252455 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f79626b6-7ced-4e22-8892-e7c90984d4d1 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:07.415552 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-f79626b6-7ced-4e22-8892-e7c90984d4d1 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:07.424293 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-f79626b6-7ced-4e22-8892-e7c90984d4d1 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:07.425916 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-f79626b6-7ced-4e22-8892-e7c90984d4d1 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:07.427117 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-f79626b6-7ced-4e22-8892-e7c90984d4d1 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1737 microversion: 2.20 time: 0.195061 Sep 30 19:34:07.427679 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 315/605] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:34:07 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1737 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:34:08.454851 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-7bdffc02-d349-4c48-ab01-b384a47b02ab tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:34:08.455668 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-7bdffc02-d349-4c48-ab01-b384a47b02ab tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:34:08.462219 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7bdffc02-d349-4c48-ab01-b384a47b02ab tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:08.463153 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7bdffc02-d349-4c48-ab01-b384a47b02ab tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:08.463819 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7bdffc02-d349-4c48-ab01-b384a47b02ab tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:08.464837 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7bdffc02-d349-4c48-ab01-b384a47b02ab tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:08.465454 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7bdffc02-d349-4c48-ab01-b384a47b02ab tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:08.465875 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7bdffc02-d349-4c48-ab01-b384a47b02ab tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:08.683958 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-7bdffc02-d349-4c48-ab01-b384a47b02ab tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:08.692286 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-7bdffc02-d349-4c48-ab01-b384a47b02ab tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:08.697106 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-7bdffc02-d349-4c48-ab01-b384a47b02ab tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:08.698650 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-7bdffc02-d349-4c48-ab01-b384a47b02ab tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1737 microversion: 2.20 time: 0.248328 Sep 30 19:34:08.707693 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 291/606] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:34:08 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1737 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:34:09.725222 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-ccd2d477-aff0-41fd-9d94-d90c21f13ea0 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:34:09.725832 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-ccd2d477-aff0-41fd-9d94-d90c21f13ea0 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:34:09.733448 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ccd2d477-aff0-41fd-9d94-d90c21f13ea0 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:09.734429 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ccd2d477-aff0-41fd-9d94-d90c21f13ea0 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:09.735067 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ccd2d477-aff0-41fd-9d94-d90c21f13ea0 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:09.739577 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ccd2d477-aff0-41fd-9d94-d90c21f13ea0 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:09.740152 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ccd2d477-aff0-41fd-9d94-d90c21f13ea0 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:09.741227 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ccd2d477-aff0-41fd-9d94-d90c21f13ea0 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:09.900518 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-ccd2d477-aff0-41fd-9d94-d90c21f13ea0 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:09.908676 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-ccd2d477-aff0-41fd-9d94-d90c21f13ea0 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:09.910384 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-ccd2d477-aff0-41fd-9d94-d90c21f13ea0 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:09.911533 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-ccd2d477-aff0-41fd-9d94-d90c21f13ea0 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1737 microversion: 2.20 time: 0.190993 Sep 30 19:34:09.913002 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 316/607] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:34:09 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1737 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:34:10.937204 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-f83a02d3-2025-4c91-8344-4fa228526f27 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:34:10.938552 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-f83a02d3-2025-4c91-8344-4fa228526f27 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:34:10.945357 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f83a02d3-2025-4c91-8344-4fa228526f27 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:10.946237 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f83a02d3-2025-4c91-8344-4fa228526f27 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:10.946678 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f83a02d3-2025-4c91-8344-4fa228526f27 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:10.947415 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f83a02d3-2025-4c91-8344-4fa228526f27 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:10.947885 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f83a02d3-2025-4c91-8344-4fa228526f27 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:10.948327 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f83a02d3-2025-4c91-8344-4fa228526f27 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:11.082914 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f83a02d3-2025-4c91-8344-4fa228526f27 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:11.091760 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f83a02d3-2025-4c91-8344-4fa228526f27 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:11.093430 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f83a02d3-2025-4c91-8344-4fa228526f27 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:11.094740 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-f83a02d3-2025-4c91-8344-4fa228526f27 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1737 microversion: 2.20 time: 0.161420 Sep 30 19:34:11.095402 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 292/608] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:34:10 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:34:12.121918 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-325f2d0a-e1ae-418b-b29b-9075d069b6bc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:34:12.123170 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-325f2d0a-e1ae-418b-b29b-9075d069b6bc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:34:12.129324 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-325f2d0a-e1ae-418b-b29b-9075d069b6bc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:12.129800 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-325f2d0a-e1ae-418b-b29b-9075d069b6bc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:12.130235 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-325f2d0a-e1ae-418b-b29b-9075d069b6bc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:12.131578 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-325f2d0a-e1ae-418b-b29b-9075d069b6bc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:12.132031 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-325f2d0a-e1ae-418b-b29b-9075d069b6bc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:12.132473 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-325f2d0a-e1ae-418b-b29b-9075d069b6bc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:12.294411 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-325f2d0a-e1ae-418b-b29b-9075d069b6bc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:12.303813 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-325f2d0a-e1ae-418b-b29b-9075d069b6bc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:12.306123 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-325f2d0a-e1ae-418b-b29b-9075d069b6bc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:12.308113 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-325f2d0a-e1ae-418b-b29b-9075d069b6bc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1737 microversion: 2.20 time: 0.189878 Sep 30 19:34:12.309319 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 317/609] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:34:12 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1737 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:34:13.336355 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-375bcd75-6350-4a42-94d3-af056ea1e9ec tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:34:13.336910 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-375bcd75-6350-4a42-94d3-af056ea1e9ec tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:34:13.344838 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-375bcd75-6350-4a42-94d3-af056ea1e9ec tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:13.345546 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-375bcd75-6350-4a42-94d3-af056ea1e9ec tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:13.346047 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-375bcd75-6350-4a42-94d3-af056ea1e9ec tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:13.346801 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-375bcd75-6350-4a42-94d3-af056ea1e9ec tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:13.347317 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-375bcd75-6350-4a42-94d3-af056ea1e9ec tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:13.347834 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-375bcd75-6350-4a42-94d3-af056ea1e9ec tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:13.495906 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-375bcd75-6350-4a42-94d3-af056ea1e9ec tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:13.505036 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-375bcd75-6350-4a42-94d3-af056ea1e9ec tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:13.507283 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-375bcd75-6350-4a42-94d3-af056ea1e9ec tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:13.508708 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-375bcd75-6350-4a42-94d3-af056ea1e9ec tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1737 microversion: 2.20 time: 0.177547 Sep 30 19:34:13.509433 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 293/610] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:34:13 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1737 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:34:14.536319 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-ac745e33-e644-482e-ab9e-3667f3e879bc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:34:14.537890 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-ac745e33-e644-482e-ab9e-3667f3e879bc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:34:14.548777 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ac745e33-e644-482e-ab9e-3667f3e879bc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:14.549345 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ac745e33-e644-482e-ab9e-3667f3e879bc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:14.550012 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ac745e33-e644-482e-ab9e-3667f3e879bc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:14.552238 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ac745e33-e644-482e-ab9e-3667f3e879bc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:14.553398 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ac745e33-e644-482e-ab9e-3667f3e879bc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:14.554139 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ac745e33-e644-482e-ab9e-3667f3e879bc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:14.702632 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-ac745e33-e644-482e-ab9e-3667f3e879bc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:14.710614 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-ac745e33-e644-482e-ab9e-3667f3e879bc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:14.712106 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-ac745e33-e644-482e-ab9e-3667f3e879bc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:14.713692 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-ac745e33-e644-482e-ab9e-3667f3e879bc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1737 microversion: 2.20 time: 0.183182 Sep 30 19:34:14.720070 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 318/611] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:34:14 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1737 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:34:15.741810 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-f883cbce-6112-4a9f-baf3-21f701344627 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:34:15.742645 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-f883cbce-6112-4a9f-baf3-21f701344627 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:34:15.753651 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f883cbce-6112-4a9f-baf3-21f701344627 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:15.754364 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f883cbce-6112-4a9f-baf3-21f701344627 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:15.755008 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f883cbce-6112-4a9f-baf3-21f701344627 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:15.756485 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f883cbce-6112-4a9f-baf3-21f701344627 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:15.756949 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f883cbce-6112-4a9f-baf3-21f701344627 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:15.757377 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f883cbce-6112-4a9f-baf3-21f701344627 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:15.901136 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f883cbce-6112-4a9f-baf3-21f701344627 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:15.913383 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f883cbce-6112-4a9f-baf3-21f701344627 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:15.915329 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f883cbce-6112-4a9f-baf3-21f701344627 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:15.916870 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-f883cbce-6112-4a9f-baf3-21f701344627 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1737 microversion: 2.20 time: 0.179105 Sep 30 19:34:15.932883 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 294/612] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:34:15 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1737 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:34:16.943964 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-5896525d-9232-4adf-90c7-18ae23a513a7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:34:16.944602 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-5896525d-9232-4adf-90c7-18ae23a513a7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:34:16.951019 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5896525d-9232-4adf-90c7-18ae23a513a7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:16.951499 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5896525d-9232-4adf-90c7-18ae23a513a7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:16.951935 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5896525d-9232-4adf-90c7-18ae23a513a7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:16.952677 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5896525d-9232-4adf-90c7-18ae23a513a7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:16.953134 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5896525d-9232-4adf-90c7-18ae23a513a7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:16.953560 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5896525d-9232-4adf-90c7-18ae23a513a7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:17.078991 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-5896525d-9232-4adf-90c7-18ae23a513a7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:17.087579 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-5896525d-9232-4adf-90c7-18ae23a513a7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:17.089044 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-5896525d-9232-4adf-90c7-18ae23a513a7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:17.090193 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-5896525d-9232-4adf-90c7-18ae23a513a7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1737 microversion: 2.20 time: 0.150572 Sep 30 19:34:17.090744 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 319/613] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:34:16 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:34:18.216683 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-6cce984b-6239-4a7c-8c42-b6532ed0877b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:34:18.217297 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-6cce984b-6239-4a7c-8c42-b6532ed0877b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:34:18.223226 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6cce984b-6239-4a7c-8c42-b6532ed0877b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:18.223748 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6cce984b-6239-4a7c-8c42-b6532ed0877b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:18.224262 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6cce984b-6239-4a7c-8c42-b6532ed0877b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:18.225547 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6cce984b-6239-4a7c-8c42-b6532ed0877b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:18.226008 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6cce984b-6239-4a7c-8c42-b6532ed0877b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:18.226446 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6cce984b-6239-4a7c-8c42-b6532ed0877b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:18.352339 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-6cce984b-6239-4a7c-8c42-b6532ed0877b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:18.360422 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-6cce984b-6239-4a7c-8c42-b6532ed0877b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:18.361861 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-6cce984b-6239-4a7c-8c42-b6532ed0877b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:18.363010 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-6cce984b-6239-4a7c-8c42-b6532ed0877b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1719 microversion: 2.20 time: 0.251923 Sep 30 19:34:18.363567 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 295/614] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:34:18 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1719 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:34:19.388133 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-52df67d5-5107-4230-8c21-7716baa8bc88 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:34:19.388683 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-52df67d5-5107-4230-8c21-7716baa8bc88 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:34:19.391586 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 30 19:34:19.391718 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Fri Sep 30 19:34:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df (ip 10.222.0.17) !!! Sep 30 19:34:19.403272 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-52df67d5-5107-4230-8c21-7716baa8bc88 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:19.403412 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-52df67d5-5107-4230-8c21-7716baa8bc88 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:19.403843 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-52df67d5-5107-4230-8c21-7716baa8bc88 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:19.404571 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-52df67d5-5107-4230-8c21-7716baa8bc88 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:19.405025 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-52df67d5-5107-4230-8c21-7716baa8bc88 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:19.405444 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-52df67d5-5107-4230-8c21-7716baa8bc88 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:19.410238 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell1:SELECT=100 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:34:19.535349 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-52df67d5-5107-4230-8c21-7716baa8bc88 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:19.543946 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-52df67d5-5107-4230-8c21-7716baa8bc88 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:19.545451 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-52df67d5-5107-4230-8c21-7716baa8bc88 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:19.546604 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-52df67d5-5107-4230-8c21-7716baa8bc88 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1719 microversion: 2.20 time: 0.162452 Sep 30 19:34:19.547160 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 320/615] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:34:19 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1719 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:34:20.463641 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-12ff4d7a-b40e-47f1-b706-3781ea130142 req-c90fca56-568f-4b6f-a656-f9038ddd0e2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c87cf7d2-5d47-474b-b2f0-1ddc37bc97df", "name": "network-vif-unplugged", "status": "completed", "tag": "408315e4-bcde-4577-8c32-5d47d233c194"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:34:20.469621 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 30 19:34:20.469851 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Fri Sep 30 19:34:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.17) !!! Sep 30 19:34:20.476986 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-12ff4d7a-b40e-47f1-b706-3781ea130142 req-c90fca56-568f-4b6f-a656-f9038ddd0e2d service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:20.477499 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-12ff4d7a-b40e-47f1-b706-3781ea130142 req-c90fca56-568f-4b6f-a656-f9038ddd0e2d service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:20.477925 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-12ff4d7a-b40e-47f1-b706-3781ea130142 req-c90fca56-568f-4b6f-a656-f9038ddd0e2d service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:20.488985 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-12ff4d7a-b40e-47f1-b706-3781ea130142 req-c90fca56-568f-4b6f-a656-f9038ddd0e2d service nova] Creating event network-vif-unplugged:408315e4-bcde-4577-8c32-5d47d233c194 for instance c87cf7d2-5d47-474b-b2f0-1ddc37bc97df on hv-cinder-86001 Sep 30 19:34:20.494289 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-12ff4d7a-b40e-47f1-b706-3781ea130142 req-c90fca56-568f-4b6f-a656-f9038ddd0e2d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034336 Sep 30 19:34:20.494858 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 296/616] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:34:20.572073 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-4d872f82-67fe-4765-8cf8-d2ff51c74af8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:34:20.572709 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-4d872f82-67fe-4765-8cf8-d2ff51c74af8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:34:20.579049 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4d872f82-67fe-4765-8cf8-d2ff51c74af8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:20.579535 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4d872f82-67fe-4765-8cf8-d2ff51c74af8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:20.579971 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4d872f82-67fe-4765-8cf8-d2ff51c74af8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:20.580686 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4d872f82-67fe-4765-8cf8-d2ff51c74af8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:20.581140 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4d872f82-67fe-4765-8cf8-d2ff51c74af8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:20.581563 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4d872f82-67fe-4765-8cf8-d2ff51c74af8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:20.710737 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-4d872f82-67fe-4765-8cf8-d2ff51c74af8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:20.718714 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-4d872f82-67fe-4765-8cf8-d2ff51c74af8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:20.720140 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-4d872f82-67fe-4765-8cf8-d2ff51c74af8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:20.721315 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-4d872f82-67fe-4765-8cf8-d2ff51c74af8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1722 microversion: 2.20 time: 0.153745 Sep 30 19:34:20.721876 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 321/617] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:34:20 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:34:20.747741 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-f1d0bb42-1c62-447f-8d23-752627be15bb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b4adb4db-43c0-4fc3-baa0-8d2db21c8972"}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:34:20.750269 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-f1d0bb42-1c62-447f-8d23-752627be15bb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:34:20.756444 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f1d0bb42-1c62-447f-8d23-752627be15bb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:20.756932 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f1d0bb42-1c62-447f-8d23-752627be15bb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:20.757371 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f1d0bb42-1c62-447f-8d23-752627be15bb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:20.758066 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f1d0bb42-1c62-447f-8d23-752627be15bb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:20.758524 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f1d0bb42-1c62-447f-8d23-752627be15bb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:20.758953 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f1d0bb42-1c62-447f-8d23-752627be15bb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:21.029030 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-f1d0bb42-1c62-447f-8d23-752627be15bb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "POST /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.285766 Sep 30 19:34:21.029620 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 297/618] 10.222.0.17 () {62 vars in 1364 bytes} [Fri Sep 30 19:34:20 2022] POST /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df/os-volume_attachments => generated 188 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 30 19:34:21.152393 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-43f04eef-cda3-4c2f-985e-d2143be09e29 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:34:21.152990 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-43f04eef-cda3-4c2f-985e-d2143be09e29 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:34:21.159060 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-43f04eef-cda3-4c2f-985e-d2143be09e29 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:21.159930 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-43f04eef-cda3-4c2f-985e-d2143be09e29 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:21.160592 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-43f04eef-cda3-4c2f-985e-d2143be09e29 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:21.161539 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-43f04eef-cda3-4c2f-985e-d2143be09e29 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:21.162580 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-43f04eef-cda3-4c2f-985e-d2143be09e29 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:21.163005 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-43f04eef-cda3-4c2f-985e-d2143be09e29 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:21.246003 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-43f04eef-cda3-4c2f-985e-d2143be09e29 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120649) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 30 19:34:21.314589 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-43f04eef-cda3-4c2f-985e-d2143be09e29 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "POST /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df/action" status: 202 len: 0 microversion: 2.20 time: 0.166069 Sep 30 19:34:21.315367 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 322/619] 10.222.0.17 () {62 vars in 1319 bytes} [Fri Sep 30 19:34:21 2022] POST /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 30 19:34:21.323367 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-c5be3bcb-d344-4aba-8f65-0e81b40b0f02 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:34:21.323973 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-c5be3bcb-d344-4aba-8f65-0e81b40b0f02 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:34:21.330849 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c5be3bcb-d344-4aba-8f65-0e81b40b0f02 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:21.331314 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c5be3bcb-d344-4aba-8f65-0e81b40b0f02 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:21.331742 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c5be3bcb-d344-4aba-8f65-0e81b40b0f02 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:21.334100 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c5be3bcb-d344-4aba-8f65-0e81b40b0f02 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:21.334565 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c5be3bcb-d344-4aba-8f65-0e81b40b0f02 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:21.335009 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c5be3bcb-d344-4aba-8f65-0e81b40b0f02 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:21.474714 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-c5be3bcb-d344-4aba-8f65-0e81b40b0f02 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:21.483283 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-c5be3bcb-d344-4aba-8f65-0e81b40b0f02 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:21.484751 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-c5be3bcb-d344-4aba-8f65-0e81b40b0f02 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:21.485910 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-c5be3bcb-d344-4aba-8f65-0e81b40b0f02 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1748 microversion: 2.20 time: 0.166404 Sep 30 19:34:21.486464 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 298/620] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:34:21 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1748 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:34:22.511110 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-00eeac18-dd1b-46d0-8312-2fb5c4b48744 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:34:22.511711 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-00eeac18-dd1b-46d0-8312-2fb5c4b48744 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:34:22.518124 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-00eeac18-dd1b-46d0-8312-2fb5c4b48744 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:22.518603 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-00eeac18-dd1b-46d0-8312-2fb5c4b48744 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:22.519037 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-00eeac18-dd1b-46d0-8312-2fb5c4b48744 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:22.519719 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-00eeac18-dd1b-46d0-8312-2fb5c4b48744 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:22.520165 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-00eeac18-dd1b-46d0-8312-2fb5c4b48744 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:22.520613 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-00eeac18-dd1b-46d0-8312-2fb5c4b48744 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:22.649504 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-00eeac18-dd1b-46d0-8312-2fb5c4b48744 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:22.657955 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-00eeac18-dd1b-46d0-8312-2fb5c4b48744 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:22.659693 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-00eeac18-dd1b-46d0-8312-2fb5c4b48744 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:22.660896 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-00eeac18-dd1b-46d0-8312-2fb5c4b48744 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1750 microversion: 2.20 time: 0.153621 Sep 30 19:34:22.661446 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 323/621] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:34:22 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1750 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:34:23.686787 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-f3a7a363-00ec-483b-b2bd-e4b7ad118fb7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:34:23.687389 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-f3a7a363-00ec-483b-b2bd-e4b7ad118fb7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:34:23.689806 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=42 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:34:23.695464 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f3a7a363-00ec-483b-b2bd-e4b7ad118fb7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:23.695940 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f3a7a363-00ec-483b-b2bd-e4b7ad118fb7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:23.696401 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f3a7a363-00ec-483b-b2bd-e4b7ad118fb7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:23.697066 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f3a7a363-00ec-483b-b2bd-e4b7ad118fb7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:23.697513 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f3a7a363-00ec-483b-b2bd-e4b7ad118fb7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:23.697934 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f3a7a363-00ec-483b-b2bd-e4b7ad118fb7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:23.702158 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:34:23.826781 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f3a7a363-00ec-483b-b2bd-e4b7ad118fb7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:23.835338 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f3a7a363-00ec-483b-b2bd-e4b7ad118fb7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:23.836776 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f3a7a363-00ec-483b-b2bd-e4b7ad118fb7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:23.837930 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-f3a7a363-00ec-483b-b2bd-e4b7ad118fb7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1806 microversion: 2.20 time: 0.155077 Sep 30 19:34:23.838482 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 299/622] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:34:23 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1806 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:34:24.862834 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-e52c4c0b-fff0-4b3e-bafe-1c5795137dbc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:34:24.863440 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-e52c4c0b-fff0-4b3e-bafe-1c5795137dbc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:34:24.870133 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e52c4c0b-fff0-4b3e-bafe-1c5795137dbc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:24.870599 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e52c4c0b-fff0-4b3e-bafe-1c5795137dbc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:24.871034 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e52c4c0b-fff0-4b3e-bafe-1c5795137dbc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:24.871729 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e52c4c0b-fff0-4b3e-bafe-1c5795137dbc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:24.872184 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e52c4c0b-fff0-4b3e-bafe-1c5795137dbc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:24.872639 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e52c4c0b-fff0-4b3e-bafe-1c5795137dbc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:25.013650 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-e52c4c0b-fff0-4b3e-bafe-1c5795137dbc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:25.023381 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-e52c4c0b-fff0-4b3e-bafe-1c5795137dbc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:25.024857 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-e52c4c0b-fff0-4b3e-bafe-1c5795137dbc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:25.026246 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-e52c4c0b-fff0-4b3e-bafe-1c5795137dbc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1806 microversion: 2.20 time: 0.167227 Sep 30 19:34:25.027460 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 324/623] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:34:24 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1806 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:34:26.051956 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-f6d31ced-0569-4e4e-b240-206ebe146975 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:34:26.053249 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-f6d31ced-0569-4e4e-b240-206ebe146975 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:34:26.060360 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f6d31ced-0569-4e4e-b240-206ebe146975 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:26.060875 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f6d31ced-0569-4e4e-b240-206ebe146975 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:26.061315 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f6d31ced-0569-4e4e-b240-206ebe146975 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:26.062020 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f6d31ced-0569-4e4e-b240-206ebe146975 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:26.062478 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f6d31ced-0569-4e4e-b240-206ebe146975 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:26.062905 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f6d31ced-0569-4e4e-b240-206ebe146975 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:26.199999 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f6d31ced-0569-4e4e-b240-206ebe146975 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:26.209301 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f6d31ced-0569-4e4e-b240-206ebe146975 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:26.210732 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f6d31ced-0569-4e4e-b240-206ebe146975 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:26.211899 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-f6d31ced-0569-4e4e-b240-206ebe146975 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1806 microversion: 2.20 time: 0.163820 Sep 30 19:34:26.212482 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 300/624] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:34:26 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1806 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:34:27.237935 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-01103527-41da-4527-a8e8-250058d8e417 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:34:27.238574 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-01103527-41da-4527-a8e8-250058d8e417 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:34:27.242995 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:34:27.247034 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-01103527-41da-4527-a8e8-250058d8e417 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:27.247525 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-01103527-41da-4527-a8e8-250058d8e417 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:27.247965 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-01103527-41da-4527-a8e8-250058d8e417 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:27.248715 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-01103527-41da-4527-a8e8-250058d8e417 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:27.249203 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-01103527-41da-4527-a8e8-250058d8e417 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:27.249635 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-01103527-41da-4527-a8e8-250058d8e417 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:27.386215 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-01103527-41da-4527-a8e8-250058d8e417 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:27.395060 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-01103527-41da-4527-a8e8-250058d8e417 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:27.396653 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-01103527-41da-4527-a8e8-250058d8e417 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:27.397830 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-01103527-41da-4527-a8e8-250058d8e417 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1806 microversion: 2.20 time: 0.163890 Sep 30 19:34:27.398583 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 325/625] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:34:27 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1806 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:34:28.423065 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-a1bc864f-2ea8-4b45-9262-4c115ef04a42 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:34:28.423665 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-a1bc864f-2ea8-4b45-9262-4c115ef04a42 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:34:28.430721 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a1bc864f-2ea8-4b45-9262-4c115ef04a42 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:28.431198 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a1bc864f-2ea8-4b45-9262-4c115ef04a42 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:28.431628 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a1bc864f-2ea8-4b45-9262-4c115ef04a42 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:28.432317 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a1bc864f-2ea8-4b45-9262-4c115ef04a42 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:28.432792 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a1bc864f-2ea8-4b45-9262-4c115ef04a42 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:28.433208 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a1bc864f-2ea8-4b45-9262-4c115ef04a42 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:28.564632 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-a1bc864f-2ea8-4b45-9262-4c115ef04a42 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:28.574039 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-a1bc864f-2ea8-4b45-9262-4c115ef04a42 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:28.575477 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-a1bc864f-2ea8-4b45-9262-4c115ef04a42 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:28.576716 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-a1bc864f-2ea8-4b45-9262-4c115ef04a42 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1806 microversion: 2.20 time: 0.157493 Sep 30 19:34:28.577290 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 301/626] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:34:28 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:34:29.601860 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-cfc9d642-23b8-4d3d-b621-69e5efa76b46 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:34:29.602468 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-cfc9d642-23b8-4d3d-b621-69e5efa76b46 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:34:29.608991 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-cfc9d642-23b8-4d3d-b621-69e5efa76b46 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:29.609464 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-cfc9d642-23b8-4d3d-b621-69e5efa76b46 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:29.609894 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-cfc9d642-23b8-4d3d-b621-69e5efa76b46 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:29.610582 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-cfc9d642-23b8-4d3d-b621-69e5efa76b46 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:29.611027 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-cfc9d642-23b8-4d3d-b621-69e5efa76b46 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:29.611447 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-cfc9d642-23b8-4d3d-b621-69e5efa76b46 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:29.743338 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-cfc9d642-23b8-4d3d-b621-69e5efa76b46 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:29.753075 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-cfc9d642-23b8-4d3d-b621-69e5efa76b46 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:29.754574 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-cfc9d642-23b8-4d3d-b621-69e5efa76b46 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:29.755769 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-cfc9d642-23b8-4d3d-b621-69e5efa76b46 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1806 microversion: 2.20 time: 0.157843 Sep 30 19:34:29.756557 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 326/627] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:34:29 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:34:30.367002 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-7f65e18b-7da9-429f-b928-b0746c1a70d8 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e29cd59a-1410-41be-ad01-d23ec3d14174"}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:34:30.369495 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-7f65e18b-7da9-429f-b928-b0746c1a70d8 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:34:30.375776 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7f65e18b-7da9-429f-b928-b0746c1a70d8 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:30.376265 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7f65e18b-7da9-429f-b928-b0746c1a70d8 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:30.376739 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7f65e18b-7da9-429f-b928-b0746c1a70d8 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:30.377467 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7f65e18b-7da9-429f-b928-b0746c1a70d8 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:30.378564 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7f65e18b-7da9-429f-b928-b0746c1a70d8 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:30.379002 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7f65e18b-7da9-429f-b928-b0746c1a70d8 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:30.781280 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-fbbc45e8-db87-4561-a4bd-ed7e5ab008dc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:34:30.782014 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-fbbc45e8-db87-4561-a4bd-ed7e5ab008dc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:34:30.789237 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-fbbc45e8-db87-4561-a4bd-ed7e5ab008dc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:30.789725 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-fbbc45e8-db87-4561-a4bd-ed7e5ab008dc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:30.790163 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-fbbc45e8-db87-4561-a4bd-ed7e5ab008dc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:30.790862 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-fbbc45e8-db87-4561-a4bd-ed7e5ab008dc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:30.791314 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-fbbc45e8-db87-4561-a4bd-ed7e5ab008dc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:30.791735 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-fbbc45e8-db87-4561-a4bd-ed7e5ab008dc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:30.926254 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-fbbc45e8-db87-4561-a4bd-ed7e5ab008dc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:30.934815 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-fbbc45e8-db87-4561-a4bd-ed7e5ab008dc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:30.936252 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-fbbc45e8-db87-4561-a4bd-ed7e5ab008dc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:30.937465 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-fbbc45e8-db87-4561-a4bd-ed7e5ab008dc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1806 microversion: 2.20 time: 0.160247 Sep 30 19:34:30.938020 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 327/628] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:34:30 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:34:31.963006 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-a8bebf7e-ebf7-45d9-b375-60f6e618ce0d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:34:31.963732 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-a8bebf7e-ebf7-45d9-b375-60f6e618ce0d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:34:31.969968 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a8bebf7e-ebf7-45d9-b375-60f6e618ce0d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:31.970452 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a8bebf7e-ebf7-45d9-b375-60f6e618ce0d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:31.970891 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a8bebf7e-ebf7-45d9-b375-60f6e618ce0d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:31.971592 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a8bebf7e-ebf7-45d9-b375-60f6e618ce0d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:31.972049 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a8bebf7e-ebf7-45d9-b375-60f6e618ce0d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:31.972573 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a8bebf7e-ebf7-45d9-b375-60f6e618ce0d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:32.108191 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-a8bebf7e-ebf7-45d9-b375-60f6e618ce0d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:32.117489 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-a8bebf7e-ebf7-45d9-b375-60f6e618ce0d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:32.118906 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-a8bebf7e-ebf7-45d9-b375-60f6e618ce0d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:32.120068 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-a8bebf7e-ebf7-45d9-b375-60f6e618ce0d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1806 microversion: 2.20 time: 0.161097 Sep 30 19:34:32.120646 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 328/629] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:34:31 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:34:33.144918 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-e60af744-8629-400d-aa32-0cd1013c9f49 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:34:33.145616 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-e60af744-8629-400d-aa32-0cd1013c9f49 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:34:33.152593 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e60af744-8629-400d-aa32-0cd1013c9f49 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:33.153072 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e60af744-8629-400d-aa32-0cd1013c9f49 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:33.153501 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e60af744-8629-400d-aa32-0cd1013c9f49 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:33.154194 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e60af744-8629-400d-aa32-0cd1013c9f49 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:33.154648 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e60af744-8629-400d-aa32-0cd1013c9f49 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:33.155124 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e60af744-8629-400d-aa32-0cd1013c9f49 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:33.306840 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-e60af744-8629-400d-aa32-0cd1013c9f49 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:33.315272 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-e60af744-8629-400d-aa32-0cd1013c9f49 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:33.316817 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-e60af744-8629-400d-aa32-0cd1013c9f49 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:33.318524 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-e60af744-8629-400d-aa32-0cd1013c9f49 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1806 microversion: 2.20 time: 0.177018 Sep 30 19:34:33.319079 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 329/630] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:34:33 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1806 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:34:34.345377 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-c481da2d-21a3-4760-9f49-3888e8e07272 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:34:34.346074 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-c481da2d-21a3-4760-9f49-3888e8e07272 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:34:34.352505 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c481da2d-21a3-4760-9f49-3888e8e07272 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:34.352996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c481da2d-21a3-4760-9f49-3888e8e07272 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:34.353435 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c481da2d-21a3-4760-9f49-3888e8e07272 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:34.354139 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c481da2d-21a3-4760-9f49-3888e8e07272 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:34.354587 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c481da2d-21a3-4760-9f49-3888e8e07272 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:34.355013 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c481da2d-21a3-4760-9f49-3888e8e07272 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:34.491561 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-c481da2d-21a3-4760-9f49-3888e8e07272 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:34.500257 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-c481da2d-21a3-4760-9f49-3888e8e07272 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:34.501808 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-c481da2d-21a3-4760-9f49-3888e8e07272 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:34.503009 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-c481da2d-21a3-4760-9f49-3888e8e07272 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1806 microversion: 2.20 time: 0.161532 Sep 30 19:34:34.503576 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 330/631] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:34:34 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1806 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:34:35.530372 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-2307e049-c9c3-477f-a63e-9731d2cbff25 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:34:35.531304 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-2307e049-c9c3-477f-a63e-9731d2cbff25 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:34:35.538423 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2307e049-c9c3-477f-a63e-9731d2cbff25 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:35.539143 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2307e049-c9c3-477f-a63e-9731d2cbff25 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:35.539579 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2307e049-c9c3-477f-a63e-9731d2cbff25 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:35.540273 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2307e049-c9c3-477f-a63e-9731d2cbff25 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:35.540749 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2307e049-c9c3-477f-a63e-9731d2cbff25 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:35.541173 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2307e049-c9c3-477f-a63e-9731d2cbff25 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:35.673402 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-2307e049-c9c3-477f-a63e-9731d2cbff25 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:35.682744 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-2307e049-c9c3-477f-a63e-9731d2cbff25 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:35.684185 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-2307e049-c9c3-477f-a63e-9731d2cbff25 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:35.685392 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-2307e049-c9c3-477f-a63e-9731d2cbff25 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1806 microversion: 2.20 time: 0.159329 Sep 30 19:34:35.686134 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 331/632] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:34:35 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1806 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:34:36.710357 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-6cbe203f-942b-4b5d-ad70-8b482936462b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:34:36.711023 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-6cbe203f-942b-4b5d-ad70-8b482936462b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:34:36.717779 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6cbe203f-942b-4b5d-ad70-8b482936462b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:36.718256 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6cbe203f-942b-4b5d-ad70-8b482936462b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:36.718685 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6cbe203f-942b-4b5d-ad70-8b482936462b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:36.719363 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6cbe203f-942b-4b5d-ad70-8b482936462b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:36.719838 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6cbe203f-942b-4b5d-ad70-8b482936462b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:36.720260 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6cbe203f-942b-4b5d-ad70-8b482936462b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:36.851678 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-6cbe203f-942b-4b5d-ad70-8b482936462b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:36.860199 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-6cbe203f-942b-4b5d-ad70-8b482936462b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:36.861609 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-6cbe203f-942b-4b5d-ad70-8b482936462b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:36.862764 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-6cbe203f-942b-4b5d-ad70-8b482936462b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1806 microversion: 2.20 time: 0.156330 Sep 30 19:34:36.863319 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 332/633] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:34:36 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1806 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:34:37.888879 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-fc515286-f35d-4f3d-8723-8fb6361bb0cc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:34:37.889520 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-fc515286-f35d-4f3d-8723-8fb6361bb0cc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:34:37.895879 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-fc515286-f35d-4f3d-8723-8fb6361bb0cc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:37.896362 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-fc515286-f35d-4f3d-8723-8fb6361bb0cc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:37.896826 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-fc515286-f35d-4f3d-8723-8fb6361bb0cc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:37.897517 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-fc515286-f35d-4f3d-8723-8fb6361bb0cc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:37.897970 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-fc515286-f35d-4f3d-8723-8fb6361bb0cc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:37.898403 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-fc515286-f35d-4f3d-8723-8fb6361bb0cc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:38.022025 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-fc515286-f35d-4f3d-8723-8fb6361bb0cc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:38.030459 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-fc515286-f35d-4f3d-8723-8fb6361bb0cc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:38.031879 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-fc515286-f35d-4f3d-8723-8fb6361bb0cc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:38.033059 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-fc515286-f35d-4f3d-8723-8fb6361bb0cc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1806 microversion: 2.20 time: 0.148086 Sep 30 19:34:38.033613 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 333/634] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:34:37 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1806 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:34:39.059009 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-2c7a5201-208b-443f-86df-d15c030cb5c5 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:34:39.059614 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-2c7a5201-208b-443f-86df-d15c030cb5c5 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:34:39.065895 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2c7a5201-208b-443f-86df-d15c030cb5c5 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:39.066382 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2c7a5201-208b-443f-86df-d15c030cb5c5 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:39.066827 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2c7a5201-208b-443f-86df-d15c030cb5c5 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:39.067526 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2c7a5201-208b-443f-86df-d15c030cb5c5 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:39.067985 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2c7a5201-208b-443f-86df-d15c030cb5c5 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:39.068491 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2c7a5201-208b-443f-86df-d15c030cb5c5 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:39.201027 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-2c7a5201-208b-443f-86df-d15c030cb5c5 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:39.209941 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-2c7a5201-208b-443f-86df-d15c030cb5c5 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:39.211358 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-2c7a5201-208b-443f-86df-d15c030cb5c5 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:39.212545 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-2c7a5201-208b-443f-86df-d15c030cb5c5 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1806 microversion: 2.20 time: 0.157521 Sep 30 19:34:39.213120 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 334/635] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:34:39 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:34:40.237998 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-e4b2ac56-ea23-4a21-8af1-c38894d79dd6 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:34:40.238693 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-e4b2ac56-ea23-4a21-8af1-c38894d79dd6 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:34:40.245665 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e4b2ac56-ea23-4a21-8af1-c38894d79dd6 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:40.246145 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e4b2ac56-ea23-4a21-8af1-c38894d79dd6 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:40.246697 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e4b2ac56-ea23-4a21-8af1-c38894d79dd6 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:40.247501 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e4b2ac56-ea23-4a21-8af1-c38894d79dd6 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:40.248089 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e4b2ac56-ea23-4a21-8af1-c38894d79dd6 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:40.248577 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e4b2ac56-ea23-4a21-8af1-c38894d79dd6 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:40.376003 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=7 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:34:40.383095 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-e4b2ac56-ea23-4a21-8af1-c38894d79dd6 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:40.386599 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:34:40.392593 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-e4b2ac56-ea23-4a21-8af1-c38894d79dd6 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:40.394034 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-e4b2ac56-ea23-4a21-8af1-c38894d79dd6 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:40.395195 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-e4b2ac56-ea23-4a21-8af1-c38894d79dd6 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1806 microversion: 2.20 time: 0.161187 Sep 30 19:34:40.395751 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 335/636] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:34:40 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:34:40.533931 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=22 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:34:41.423419 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-eeafb60b-dac8-48e4-a280-fe9960ea59cd tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:34:41.424002 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-eeafb60b-dac8-48e4-a280-fe9960ea59cd tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:34:41.431304 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-eeafb60b-dac8-48e4-a280-fe9960ea59cd tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:41.431782 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-eeafb60b-dac8-48e4-a280-fe9960ea59cd tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:41.432211 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-eeafb60b-dac8-48e4-a280-fe9960ea59cd tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:41.432929 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-eeafb60b-dac8-48e4-a280-fe9960ea59cd tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:41.433380 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-eeafb60b-dac8-48e4-a280-fe9960ea59cd tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:41.433825 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-eeafb60b-dac8-48e4-a280-fe9960ea59cd tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:41.562286 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-eeafb60b-dac8-48e4-a280-fe9960ea59cd tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:41.571252 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-eeafb60b-dac8-48e4-a280-fe9960ea59cd tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:41.572755 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-eeafb60b-dac8-48e4-a280-fe9960ea59cd tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:41.573903 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-eeafb60b-dac8-48e4-a280-fe9960ea59cd tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1806 microversion: 2.20 time: 0.154977 Sep 30 19:34:41.574453 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 336/637] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:34:41 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1806 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:34:42.248181 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-7f65e18b-7da9-429f-b928-b0746c1a70d8 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "POST /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 11.990175 Sep 30 19:34:42.248809 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 302/638] 10.222.0.17 () {60 vars in 1323 bytes} [Fri Sep 30 19:34:30 2022] POST /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715/os-volume_attachments => generated 194 bytes in 11992 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:34:42.599059 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-2c3769c0-c245-4cff-adc8-96d8ff0ef967 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:34:42.599655 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-2c3769c0-c245-4cff-adc8-96d8ff0ef967 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:34:42.606276 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2c3769c0-c245-4cff-adc8-96d8ff0ef967 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:42.606804 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2c3769c0-c245-4cff-adc8-96d8ff0ef967 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:42.607243 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2c3769c0-c245-4cff-adc8-96d8ff0ef967 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:42.607925 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2c3769c0-c245-4cff-adc8-96d8ff0ef967 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:42.608393 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2c3769c0-c245-4cff-adc8-96d8ff0ef967 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:42.608832 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2c3769c0-c245-4cff-adc8-96d8ff0ef967 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:42.738403 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-2c3769c0-c245-4cff-adc8-96d8ff0ef967 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:42.747524 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-2c3769c0-c245-4cff-adc8-96d8ff0ef967 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:42.749002 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-2c3769c0-c245-4cff-adc8-96d8ff0ef967 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:42.750143 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-2c3769c0-c245-4cff-adc8-96d8ff0ef967 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1806 microversion: 2.20 time: 0.155004 Sep 30 19:34:42.750691 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 337/639] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:34:42 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1806 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:34:43.776987 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-c6707fbb-5060-4547-9b3d-c9ab7102b15f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:34:43.777689 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-c6707fbb-5060-4547-9b3d-c9ab7102b15f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:34:43.783759 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c6707fbb-5060-4547-9b3d-c9ab7102b15f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:43.784521 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c6707fbb-5060-4547-9b3d-c9ab7102b15f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:43.784963 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c6707fbb-5060-4547-9b3d-c9ab7102b15f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:43.785658 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c6707fbb-5060-4547-9b3d-c9ab7102b15f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:43.786114 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c6707fbb-5060-4547-9b3d-c9ab7102b15f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:43.786818 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c6707fbb-5060-4547-9b3d-c9ab7102b15f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:43.915511 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-c6707fbb-5060-4547-9b3d-c9ab7102b15f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:43.923899 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-c6707fbb-5060-4547-9b3d-c9ab7102b15f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:43.925341 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-c6707fbb-5060-4547-9b3d-c9ab7102b15f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:43.926491 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-c6707fbb-5060-4547-9b3d-c9ab7102b15f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1806 microversion: 2.20 time: 0.154820 Sep 30 19:34:43.927058 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 303/640] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:34:43 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1806 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:34:44.951395 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-50cc3f0e-5e47-4d5f-a7c3-97dd2ffe7cb7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:34:44.951997 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-50cc3f0e-5e47-4d5f-a7c3-97dd2ffe7cb7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:34:44.958345 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-50cc3f0e-5e47-4d5f-a7c3-97dd2ffe7cb7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:44.958825 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-50cc3f0e-5e47-4d5f-a7c3-97dd2ffe7cb7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:44.959259 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-50cc3f0e-5e47-4d5f-a7c3-97dd2ffe7cb7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:44.960541 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-50cc3f0e-5e47-4d5f-a7c3-97dd2ffe7cb7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:44.960997 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-50cc3f0e-5e47-4d5f-a7c3-97dd2ffe7cb7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:44.961422 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-50cc3f0e-5e47-4d5f-a7c3-97dd2ffe7cb7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:45.086024 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-50cc3f0e-5e47-4d5f-a7c3-97dd2ffe7cb7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:45.094456 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-50cc3f0e-5e47-4d5f-a7c3-97dd2ffe7cb7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:45.095891 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-50cc3f0e-5e47-4d5f-a7c3-97dd2ffe7cb7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:45.097084 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-50cc3f0e-5e47-4d5f-a7c3-97dd2ffe7cb7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1806 microversion: 2.20 time: 0.149553 Sep 30 19:34:45.097643 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 338/641] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:34:44 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1806 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:34:46.122590 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-c7ee85f5-527d-4fdf-af7f-516830af3bab tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:34:46.123203 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-c7ee85f5-527d-4fdf-af7f-516830af3bab tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:34:46.129515 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c7ee85f5-527d-4fdf-af7f-516830af3bab tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:46.129995 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c7ee85f5-527d-4fdf-af7f-516830af3bab tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:46.130432 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c7ee85f5-527d-4fdf-af7f-516830af3bab tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:46.131113 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c7ee85f5-527d-4fdf-af7f-516830af3bab tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:46.131607 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c7ee85f5-527d-4fdf-af7f-516830af3bab tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:46.132032 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c7ee85f5-527d-4fdf-af7f-516830af3bab tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:46.260835 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-c7ee85f5-527d-4fdf-af7f-516830af3bab tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:46.269375 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-c7ee85f5-527d-4fdf-af7f-516830af3bab tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:46.270805 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-c7ee85f5-527d-4fdf-af7f-516830af3bab tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:46.271962 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-c7ee85f5-527d-4fdf-af7f-516830af3bab tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1806 microversion: 2.20 time: 0.153270 Sep 30 19:34:46.272540 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 304/642] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:34:46 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1806 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:34:47.296745 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-d0473b27-03c4-4f68-8a17-59bae2869c82 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:34:47.297351 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-d0473b27-03c4-4f68-8a17-59bae2869c82 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:34:47.304283 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d0473b27-03c4-4f68-8a17-59bae2869c82 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:47.304790 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d0473b27-03c4-4f68-8a17-59bae2869c82 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:47.305228 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d0473b27-03c4-4f68-8a17-59bae2869c82 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:47.305911 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d0473b27-03c4-4f68-8a17-59bae2869c82 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:47.306366 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d0473b27-03c4-4f68-8a17-59bae2869c82 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:47.306790 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d0473b27-03c4-4f68-8a17-59bae2869c82 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:47.437069 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-d0473b27-03c4-4f68-8a17-59bae2869c82 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:47.446196 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-d0473b27-03c4-4f68-8a17-59bae2869c82 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:47.447641 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-d0473b27-03c4-4f68-8a17-59bae2869c82 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:47.448959 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-d0473b27-03c4-4f68-8a17-59bae2869c82 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1806 microversion: 2.20 time: 0.156224 Sep 30 19:34:47.449521 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 339/643] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:34:47 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:34:48.474299 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-150284fa-d347-456d-9835-ec67d6e8953d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:34:48.475045 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-150284fa-d347-456d-9835-ec67d6e8953d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:34:48.481492 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-150284fa-d347-456d-9835-ec67d6e8953d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:48.481995 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-150284fa-d347-456d-9835-ec67d6e8953d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:48.482436 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-150284fa-d347-456d-9835-ec67d6e8953d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:48.483128 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-150284fa-d347-456d-9835-ec67d6e8953d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:48.483591 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-150284fa-d347-456d-9835-ec67d6e8953d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:48.484012 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-150284fa-d347-456d-9835-ec67d6e8953d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:48.613061 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-150284fa-d347-456d-9835-ec67d6e8953d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:48.621744 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-150284fa-d347-456d-9835-ec67d6e8953d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:48.623462 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-150284fa-d347-456d-9835-ec67d6e8953d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:48.624421 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-150284fa-d347-456d-9835-ec67d6e8953d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1806 microversion: 2.20 time: 0.154042 Sep 30 19:34:48.624985 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 305/644] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:34:48 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1806 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:34:49.650812 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-8b53b0c8-9124-4c87-a894-ff10b7a3a1e7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:34:49.651410 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-8b53b0c8-9124-4c87-a894-ff10b7a3a1e7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:34:49.657809 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8b53b0c8-9124-4c87-a894-ff10b7a3a1e7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:49.658231 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8b53b0c8-9124-4c87-a894-ff10b7a3a1e7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:49.658659 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8b53b0c8-9124-4c87-a894-ff10b7a3a1e7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:49.659641 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8b53b0c8-9124-4c87-a894-ff10b7a3a1e7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:49.660091 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8b53b0c8-9124-4c87-a894-ff10b7a3a1e7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:49.660551 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8b53b0c8-9124-4c87-a894-ff10b7a3a1e7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:49.790655 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-8b53b0c8-9124-4c87-a894-ff10b7a3a1e7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:49.799312 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-8b53b0c8-9124-4c87-a894-ff10b7a3a1e7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:49.800779 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-8b53b0c8-9124-4c87-a894-ff10b7a3a1e7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:49.801940 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-8b53b0c8-9124-4c87-a894-ff10b7a3a1e7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1806 microversion: 2.20 time: 0.155598 Sep 30 19:34:49.802497 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 340/645] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:34:49 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:34:50.827983 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-f1ada9ef-315d-43c3-bab7-2d957f18ab5b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:34:50.828622 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-f1ada9ef-315d-43c3-bab7-2d957f18ab5b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:34:50.836068 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f1ada9ef-315d-43c3-bab7-2d957f18ab5b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:50.836425 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f1ada9ef-315d-43c3-bab7-2d957f18ab5b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:50.836860 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f1ada9ef-315d-43c3-bab7-2d957f18ab5b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:50.837552 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f1ada9ef-315d-43c3-bab7-2d957f18ab5b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:50.837997 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f1ada9ef-315d-43c3-bab7-2d957f18ab5b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:50.838796 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f1ada9ef-315d-43c3-bab7-2d957f18ab5b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:50.883443 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [req-7b737701-850f-448e-874f-287092ae7bc2 req-6e1a91c2-8f2c-46c3-bde0-023e08919feb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c87cf7d2-5d47-474b-b2f0-1ddc37bc97df", "name": "network-vif-plugged", "status": "completed", "tag": "408315e4-bcde-4577-8c32-5d47d233c194"}]} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:34:50.899495 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-7b737701-850f-448e-874f-287092ae7bc2 req-6e1a91c2-8f2c-46c3-bde0-023e08919feb service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:50.899976 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-7b737701-850f-448e-874f-287092ae7bc2 req-6e1a91c2-8f2c-46c3-bde0-023e08919feb service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:50.900509 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-7b737701-850f-448e-874f-287092ae7bc2 req-6e1a91c2-8f2c-46c3-bde0-023e08919feb service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:50.916537 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.compute.server_external_events [req-7b737701-850f-448e-874f-287092ae7bc2 req-6e1a91c2-8f2c-46c3-bde0-023e08919feb service nova] Creating event network-vif-plugged:408315e4-bcde-4577-8c32-5d47d233c194 for instance c87cf7d2-5d47-474b-b2f0-1ddc37bc97df on hv-cinder-86001 Sep 30 19:34:50.921964 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [req-7b737701-850f-448e-874f-287092ae7bc2 req-6e1a91c2-8f2c-46c3-bde0-023e08919feb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043796 Sep 30 19:34:50.922967 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 341/646] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 30 19:34:50.996241 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f1ada9ef-315d-43c3-bab7-2d957f18ab5b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:51.006174 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f1ada9ef-315d-43c3-bab7-2d957f18ab5b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:51.007657 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f1ada9ef-315d-43c3-bab7-2d957f18ab5b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:51.008855 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-f1ada9ef-315d-43c3-bab7-2d957f18ab5b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1806 microversion: 2.20 time: 0.184847 Sep 30 19:34:51.009400 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 306/647] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:34:50 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1806 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:34:51.910466 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-8cc95eb9-b1d1-4b2d-b3ba-e65305d8662d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:34:51.912711 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-8cc95eb9-b1d1-4b2d-b3ba-e65305d8662d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:34:51.919153 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8cc95eb9-b1d1-4b2d-b3ba-e65305d8662d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:51.919633 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8cc95eb9-b1d1-4b2d-b3ba-e65305d8662d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:51.920069 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8cc95eb9-b1d1-4b2d-b3ba-e65305d8662d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:51.920787 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8cc95eb9-b1d1-4b2d-b3ba-e65305d8662d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:51.921239 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8cc95eb9-b1d1-4b2d-b3ba-e65305d8662d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:51.921661 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8cc95eb9-b1d1-4b2d-b3ba-e65305d8662d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:51.944438 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.objects.instance [None req-8cc95eb9-b1d1-4b2d-b3ba-e65305d8662d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lazy-loading 'flavor' on Instance uuid 99020333-8572-4b29-bfa8-d5961bcde715 {{(pid=120649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 30 19:34:52.034947 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-0a1e7951-0214-4f71-8337-13eb9fe382f9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:34:52.035554 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-0a1e7951-0214-4f71-8337-13eb9fe382f9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:34:52.041828 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0a1e7951-0214-4f71-8337-13eb9fe382f9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:52.042310 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0a1e7951-0214-4f71-8337-13eb9fe382f9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:52.042743 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0a1e7951-0214-4f71-8337-13eb9fe382f9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:52.043460 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0a1e7951-0214-4f71-8337-13eb9fe382f9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:52.043866 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0a1e7951-0214-4f71-8337-13eb9fe382f9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:52.044283 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0a1e7951-0214-4f71-8337-13eb9fe382f9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:52.101954 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-8cc95eb9-b1d1-4b2d-b3ba-e65305d8662d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "POST /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715/action" status: 200 len: 32 microversion: 2.1 time: 0.196019 Sep 30 19:34:52.102560 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 342/648] 10.222.0.17 () {60 vars in 1278 bytes} [Fri Sep 30 19:34:51 2022] POST /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715/action => generated 32 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 30 19:34:52.112307 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-32fb344d-a053-409e-ac0d-c9174891548f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:34:52.113024 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-32fb344d-a053-409e-ac0d-c9174891548f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:34:52.119642 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-32fb344d-a053-409e-ac0d-c9174891548f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:52.120124 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-32fb344d-a053-409e-ac0d-c9174891548f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:52.120619 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-32fb344d-a053-409e-ac0d-c9174891548f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:52.121311 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-32fb344d-a053-409e-ac0d-c9174891548f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:52.121765 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-32fb344d-a053-409e-ac0d-c9174891548f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:52.122191 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-32fb344d-a053-409e-ac0d-c9174891548f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:52.177426 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-0a1e7951-0214-4f71-8337-13eb9fe382f9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:52.186960 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-0a1e7951-0214-4f71-8337-13eb9fe382f9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:52.188481 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-0a1e7951-0214-4f71-8337-13eb9fe382f9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:52.189776 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-0a1e7951-0214-4f71-8337-13eb9fe382f9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1806 microversion: 2.20 time: 0.158928 Sep 30 19:34:52.190337 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 307/649] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:34:52 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1806 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:34:52.257528 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-32fb344d-a053-409e-ac0d-c9174891548f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:52.266259 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-32fb344d-a053-409e-ac0d-c9174891548f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715" status: 200 len: 1735 microversion: 2.1 time: 0.157869 Sep 30 19:34:52.266909 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 343/650] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:34:52 2022] GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:34:53.215204 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-0128c1ef-7f4e-4ac3-b113-969ea3e50fab tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:34:53.215806 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-0128c1ef-7f4e-4ac3-b113-969ea3e50fab tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:34:53.222306 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0128c1ef-7f4e-4ac3-b113-969ea3e50fab tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:53.222783 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0128c1ef-7f4e-4ac3-b113-969ea3e50fab tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:53.223220 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0128c1ef-7f4e-4ac3-b113-969ea3e50fab tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:53.223911 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0128c1ef-7f4e-4ac3-b113-969ea3e50fab tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:53.224450 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0128c1ef-7f4e-4ac3-b113-969ea3e50fab tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:53.224838 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0128c1ef-7f4e-4ac3-b113-969ea3e50fab tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:53.290319 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-7b37e54e-b122-4afa-b63f-9f04750ad30c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:34:53.290907 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-7b37e54e-b122-4afa-b63f-9f04750ad30c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:34:53.297358 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7b37e54e-b122-4afa-b63f-9f04750ad30c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:53.297851 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7b37e54e-b122-4afa-b63f-9f04750ad30c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:53.298287 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7b37e54e-b122-4afa-b63f-9f04750ad30c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:53.298983 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7b37e54e-b122-4afa-b63f-9f04750ad30c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:53.299436 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7b37e54e-b122-4afa-b63f-9f04750ad30c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:53.299863 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7b37e54e-b122-4afa-b63f-9f04750ad30c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:53.426358 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-0128c1ef-7f4e-4ac3-b113-969ea3e50fab tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:53.433693 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-7b37e54e-b122-4afa-b63f-9f04750ad30c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:53.435803 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-0128c1ef-7f4e-4ac3-b113-969ea3e50fab tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:53.437379 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-0128c1ef-7f4e-4ac3-b113-969ea3e50fab tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:53.438670 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-0128c1ef-7f4e-4ac3-b113-969ea3e50fab tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1806 microversion: 2.20 time: 0.227351 Sep 30 19:34:53.439326 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 308/651] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:34:53 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1806 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:34:53.443185 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-7b37e54e-b122-4afa-b63f-9f04750ad30c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715" status: 200 len: 1735 microversion: 2.1 time: 0.156619 Sep 30 19:34:53.447029 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 344/652] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:34:53 2022] GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:34:54.467288 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-4bbfbcf3-be59-458a-bb34-6aa5fc327b6b tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:34:54.467843 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-38189173-1917-4cef-be09-9a7fec3c960e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:34:54.468244 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-38189173-1917-4cef-be09-9a7fec3c960e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:34:54.468360 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-4bbfbcf3-be59-458a-bb34-6aa5fc327b6b tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:34:54.474072 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-38189173-1917-4cef-be09-9a7fec3c960e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:54.474575 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-38189173-1917-4cef-be09-9a7fec3c960e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:54.474746 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4bbfbcf3-be59-458a-bb34-6aa5fc327b6b tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:54.475057 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-38189173-1917-4cef-be09-9a7fec3c960e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:54.475934 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-38189173-1917-4cef-be09-9a7fec3c960e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:54.476058 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4bbfbcf3-be59-458a-bb34-6aa5fc327b6b tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:54.476386 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-38189173-1917-4cef-be09-9a7fec3c960e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:54.476773 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4bbfbcf3-be59-458a-bb34-6aa5fc327b6b tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:54.476892 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-38189173-1917-4cef-be09-9a7fec3c960e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:54.477471 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4bbfbcf3-be59-458a-bb34-6aa5fc327b6b tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:54.477922 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4bbfbcf3-be59-458a-bb34-6aa5fc327b6b tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:54.478344 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4bbfbcf3-be59-458a-bb34-6aa5fc327b6b tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:54.617807 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-38189173-1917-4cef-be09-9a7fec3c960e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:54.618989 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-4bbfbcf3-be59-458a-bb34-6aa5fc327b6b tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:54.627238 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-38189173-1917-4cef-be09-9a7fec3c960e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:54.627750 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-4bbfbcf3-be59-458a-bb34-6aa5fc327b6b tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715" status: 200 len: 1735 microversion: 2.1 time: 0.164468 Sep 30 19:34:54.628322 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 309/653] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:34:54 2022] GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:34:54.629732 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-38189173-1917-4cef-be09-9a7fec3c960e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:54.631020 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-38189173-1917-4cef-be09-9a7fec3c960e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1806 microversion: 2.20 time: 0.167825 Sep 30 19:34:54.632166 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 345/654] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:34:54 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1806 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:34:55.652518 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-f02031dc-41b1-44ef-bd63-06b5124fe175 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:34:55.653087 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-f02031dc-41b1-44ef-bd63-06b5124fe175 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:34:55.657055 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-f54cf3e2-3675-4d62-afa9-3d5bc0de785c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:34:55.657744 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-f54cf3e2-3675-4d62-afa9-3d5bc0de785c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:34:55.659688 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f02031dc-41b1-44ef-bd63-06b5124fe175 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:55.660171 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f02031dc-41b1-44ef-bd63-06b5124fe175 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:55.660638 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f02031dc-41b1-44ef-bd63-06b5124fe175 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:55.661336 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f02031dc-41b1-44ef-bd63-06b5124fe175 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:55.661841 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f02031dc-41b1-44ef-bd63-06b5124fe175 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:55.662270 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f02031dc-41b1-44ef-bd63-06b5124fe175 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:55.665105 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f54cf3e2-3675-4d62-afa9-3d5bc0de785c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:55.665584 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f54cf3e2-3675-4d62-afa9-3d5bc0de785c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:55.666020 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f54cf3e2-3675-4d62-afa9-3d5bc0de785c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:55.666713 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f54cf3e2-3675-4d62-afa9-3d5bc0de785c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:55.667164 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f54cf3e2-3675-4d62-afa9-3d5bc0de785c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:55.667594 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f54cf3e2-3675-4d62-afa9-3d5bc0de785c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:55.794543 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f02031dc-41b1-44ef-bd63-06b5124fe175 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:55.800796 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-f54cf3e2-3675-4d62-afa9-3d5bc0de785c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:55.802959 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-f02031dc-41b1-44ef-bd63-06b5124fe175 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715" status: 200 len: 1735 microversion: 2.1 time: 0.154416 Sep 30 19:34:55.803618 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 310/655] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:34:55 2022] GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:34:55.809325 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-f54cf3e2-3675-4d62-afa9-3d5bc0de785c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:55.810746 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-f54cf3e2-3675-4d62-afa9-3d5bc0de785c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:55.811883 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-f54cf3e2-3675-4d62-afa9-3d5bc0de785c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1793 microversion: 2.20 time: 0.158703 Sep 30 19:34:55.812461 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 346/656] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:34:55 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1793 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:34:56.826139 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-782486f9-565d-4423-9015-50b43bb260f5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:34:56.826742 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-782486f9-565d-4423-9015-50b43bb260f5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:34:56.833315 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-782486f9-565d-4423-9015-50b43bb260f5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:56.833797 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-782486f9-565d-4423-9015-50b43bb260f5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:56.834234 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-782486f9-565d-4423-9015-50b43bb260f5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:56.834932 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-782486f9-565d-4423-9015-50b43bb260f5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:56.835386 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-782486f9-565d-4423-9015-50b43bb260f5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:56.835813 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-782486f9-565d-4423-9015-50b43bb260f5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:56.963506 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-782486f9-565d-4423-9015-50b43bb260f5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:56.971698 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-782486f9-565d-4423-9015-50b43bb260f5 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715" status: 200 len: 1735 microversion: 2.1 time: 0.149410 Sep 30 19:34:56.972255 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 311/657] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:34:56 2022] GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:34:57.995226 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-3538273a-37b0-4523-9afa-8a17fe34c04f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:34:57.995827 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-3538273a-37b0-4523-9afa-8a17fe34c04f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:34:57.998220 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_api:SELECT=44 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:34:58.003417 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3538273a-37b0-4523-9afa-8a17fe34c04f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:58.003895 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3538273a-37b0-4523-9afa-8a17fe34c04f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:58.004329 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3538273a-37b0-4523-9afa-8a17fe34c04f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:58.005035 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3538273a-37b0-4523-9afa-8a17fe34c04f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:58.005487 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3538273a-37b0-4523-9afa-8a17fe34c04f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:58.005910 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3538273a-37b0-4523-9afa-8a17fe34c04f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:58.129986 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-3538273a-37b0-4523-9afa-8a17fe34c04f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:58.138524 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-3538273a-37b0-4523-9afa-8a17fe34c04f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715" status: 200 len: 1735 microversion: 2.1 time: 0.147236 Sep 30 19:34:58.139081 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 347/658] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:34:57 2022] GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:34:59.163087 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-b64dc85a-7432-467f-928b-bdd7a8bc14ab tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:34:59.163846 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-b64dc85a-7432-467f-928b-bdd7a8bc14ab tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:34:59.170430 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b64dc85a-7432-467f-928b-bdd7a8bc14ab tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:59.170910 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b64dc85a-7432-467f-928b-bdd7a8bc14ab tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:59.171338 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b64dc85a-7432-467f-928b-bdd7a8bc14ab tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:59.172019 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b64dc85a-7432-467f-928b-bdd7a8bc14ab tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:34:59.172500 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b64dc85a-7432-467f-928b-bdd7a8bc14ab tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:34:59.172921 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b64dc85a-7432-467f-928b-bdd7a8bc14ab tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:34:59.296495 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-b64dc85a-7432-467f-928b-bdd7a8bc14ab tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:34:59.305219 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-b64dc85a-7432-467f-928b-bdd7a8bc14ab tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715" status: 200 len: 1735 microversion: 2.1 time: 0.146864 Sep 30 19:34:59.305783 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 312/659] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:34:59 2022] GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:00.328873 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-11df6cc5-8d1f-4ba8-9685-668e0ae2a394 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:00.329456 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-11df6cc5-8d1f-4ba8-9685-668e0ae2a394 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:00.336332 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-11df6cc5-8d1f-4ba8-9685-668e0ae2a394 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:00.336835 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-11df6cc5-8d1f-4ba8-9685-668e0ae2a394 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:00.337269 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-11df6cc5-8d1f-4ba8-9685-668e0ae2a394 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:00.337951 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-11df6cc5-8d1f-4ba8-9685-668e0ae2a394 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:00.338408 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-11df6cc5-8d1f-4ba8-9685-668e0ae2a394 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:00.338828 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-11df6cc5-8d1f-4ba8-9685-668e0ae2a394 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:00.468350 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-11df6cc5-8d1f-4ba8-9685-668e0ae2a394 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:00.476497 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-11df6cc5-8d1f-4ba8-9685-668e0ae2a394 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715" status: 200 len: 1735 microversion: 2.1 time: 0.151426 Sep 30 19:35:00.477055 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 348/660] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:00 2022] GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:01.499728 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-d89848d8-598e-408a-ac3a-1aea73db9339 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:01.500332 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-d89848d8-598e-408a-ac3a-1aea73db9339 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:01.506726 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d89848d8-598e-408a-ac3a-1aea73db9339 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:01.507217 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d89848d8-598e-408a-ac3a-1aea73db9339 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:01.507646 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d89848d8-598e-408a-ac3a-1aea73db9339 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:01.508321 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d89848d8-598e-408a-ac3a-1aea73db9339 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:01.508793 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d89848d8-598e-408a-ac3a-1aea73db9339 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:01.509212 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d89848d8-598e-408a-ac3a-1aea73db9339 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:01.640915 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-d89848d8-598e-408a-ac3a-1aea73db9339 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:01.649531 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-d89848d8-598e-408a-ac3a-1aea73db9339 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715" status: 200 len: 1735 microversion: 2.1 time: 0.153673 Sep 30 19:35:01.650091 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 313/661] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:01 2022] GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:02.673708 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-8a927320-85e4-454f-a566-e97631042093 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:02.674255 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-8a927320-85e4-454f-a566-e97631042093 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:02.681348 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8a927320-85e4-454f-a566-e97631042093 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:02.681839 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8a927320-85e4-454f-a566-e97631042093 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:02.682287 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8a927320-85e4-454f-a566-e97631042093 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:02.682982 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8a927320-85e4-454f-a566-e97631042093 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:02.683446 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8a927320-85e4-454f-a566-e97631042093 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:02.683875 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8a927320-85e4-454f-a566-e97631042093 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:02.809028 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-8a927320-85e4-454f-a566-e97631042093 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:02.817003 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-8a927320-85e4-454f-a566-e97631042093 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715" status: 200 len: 1735 microversion: 2.1 time: 0.147264 Sep 30 19:35:02.817560 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 349/662] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:02 2022] GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:03.840255 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-111dfe9f-c060-4114-88fb-e39cd6c0eb2f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:03.840955 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-111dfe9f-c060-4114-88fb-e39cd6c0eb2f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:03.847465 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-111dfe9f-c060-4114-88fb-e39cd6c0eb2f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:03.847948 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-111dfe9f-c060-4114-88fb-e39cd6c0eb2f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:03.848393 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-111dfe9f-c060-4114-88fb-e39cd6c0eb2f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:03.849091 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-111dfe9f-c060-4114-88fb-e39cd6c0eb2f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:03.849545 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-111dfe9f-c060-4114-88fb-e39cd6c0eb2f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:03.849966 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-111dfe9f-c060-4114-88fb-e39cd6c0eb2f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:03.979754 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-111dfe9f-c060-4114-88fb-e39cd6c0eb2f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:03.987971 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-111dfe9f-c060-4114-88fb-e39cd6c0eb2f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715" status: 200 len: 1735 microversion: 2.1 time: 0.151597 Sep 30 19:35:03.988748 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 314/663] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:03 2022] GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:05.011663 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-1cda9314-af72-4b65-8d32-024d6dbbd47e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:05.012270 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-1cda9314-af72-4b65-8d32-024d6dbbd47e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:05.018809 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1cda9314-af72-4b65-8d32-024d6dbbd47e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:05.019299 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1cda9314-af72-4b65-8d32-024d6dbbd47e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:05.019735 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1cda9314-af72-4b65-8d32-024d6dbbd47e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:05.020534 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1cda9314-af72-4b65-8d32-024d6dbbd47e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:05.020990 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1cda9314-af72-4b65-8d32-024d6dbbd47e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:05.021416 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1cda9314-af72-4b65-8d32-024d6dbbd47e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:05.146114 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-1cda9314-af72-4b65-8d32-024d6dbbd47e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:05.154633 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-1cda9314-af72-4b65-8d32-024d6dbbd47e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715" status: 200 len: 1735 microversion: 2.1 time: 0.146989 Sep 30 19:35:05.155200 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 350/664] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:05 2022] GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:06.178022 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-a6615ab3-c595-4600-a6d8-995e98fddb58 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:06.178656 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-a6615ab3-c595-4600-a6d8-995e98fddb58 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:06.185089 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a6615ab3-c595-4600-a6d8-995e98fddb58 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:06.185568 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a6615ab3-c595-4600-a6d8-995e98fddb58 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:06.185998 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a6615ab3-c595-4600-a6d8-995e98fddb58 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:06.186675 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a6615ab3-c595-4600-a6d8-995e98fddb58 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:06.187124 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a6615ab3-c595-4600-a6d8-995e98fddb58 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:06.187545 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a6615ab3-c595-4600-a6d8-995e98fddb58 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:06.315252 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-a6615ab3-c595-4600-a6d8-995e98fddb58 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:06.323227 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-a6615ab3-c595-4600-a6d8-995e98fddb58 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715" status: 200 len: 1735 microversion: 2.1 time: 0.149043 Sep 30 19:35:06.323780 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 315/665] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:06 2022] GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:07.346788 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-21ea4d6c-1551-4a58-853f-6247bece8a64 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:07.347322 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-21ea4d6c-1551-4a58-853f-6247bece8a64 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:07.353740 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-21ea4d6c-1551-4a58-853f-6247bece8a64 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:07.354221 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-21ea4d6c-1551-4a58-853f-6247bece8a64 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:07.354659 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-21ea4d6c-1551-4a58-853f-6247bece8a64 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:07.355354 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-21ea4d6c-1551-4a58-853f-6247bece8a64 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:07.355806 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-21ea4d6c-1551-4a58-853f-6247bece8a64 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:07.356230 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-21ea4d6c-1551-4a58-853f-6247bece8a64 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:07.360148 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:35:07.485894 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-21ea4d6c-1551-4a58-853f-6247bece8a64 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:07.494626 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-21ea4d6c-1551-4a58-853f-6247bece8a64 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715" status: 200 len: 1735 microversion: 2.1 time: 0.151837 Sep 30 19:35:07.495191 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 351/666] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:07 2022] GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:08.483163 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-4ffa11e2-5575-4599-865a-f93654a5bbca tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:35:08.483687 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-4ffa11e2-5575-4599-865a-f93654a5bbca tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:08.490212 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4ffa11e2-5575-4599-865a-f93654a5bbca tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:08.490692 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4ffa11e2-5575-4599-865a-f93654a5bbca tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:08.491122 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4ffa11e2-5575-4599-865a-f93654a5bbca tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:08.491802 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4ffa11e2-5575-4599-865a-f93654a5bbca tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:08.492248 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4ffa11e2-5575-4599-865a-f93654a5bbca tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:08.492697 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4ffa11e2-5575-4599-865a-f93654a5bbca tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:08.518323 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-0f5967d6-d348-4672-a67f-35df79853e68 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:08.518896 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.objects.instance [None req-4ffa11e2-5575-4599-865a-f93654a5bbca tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lazy-loading 'flavor' on Instance uuid e4d9e349-e05e-43c7-ac04-37d75ee740ab {{(pid=120648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 30 19:35:08.519011 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-0f5967d6-d348-4672-a67f-35df79853e68 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:08.525760 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0f5967d6-d348-4672-a67f-35df79853e68 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:08.526238 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0f5967d6-d348-4672-a67f-35df79853e68 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:08.526670 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0f5967d6-d348-4672-a67f-35df79853e68 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:08.527358 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0f5967d6-d348-4672-a67f-35df79853e68 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:08.527809 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0f5967d6-d348-4672-a67f-35df79853e68 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:08.528228 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0f5967d6-d348-4672-a67f-35df79853e68 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:08.566729 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:35:08.597103 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-4ffa11e2-5575-4599-865a-f93654a5bbca tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "POST /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab/action" status: 202 len: 0 microversion: 2.1 time: 0.117559 Sep 30 19:35:08.597701 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 316/667] 10.222.0.17 () {60 vars in 1278 bytes} [Fri Sep 30 19:35:08 2022] POST /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 30 19:35:08.606746 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-42af1c16-983c-49d8-a3da-e826cbe6fba3 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:08.607431 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-42af1c16-983c-49d8-a3da-e826cbe6fba3 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:08.613494 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-42af1c16-983c-49d8-a3da-e826cbe6fba3 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:08.614004 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-42af1c16-983c-49d8-a3da-e826cbe6fba3 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:08.614574 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-42af1c16-983c-49d8-a3da-e826cbe6fba3 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:08.615874 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-42af1c16-983c-49d8-a3da-e826cbe6fba3 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:08.616354 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-42af1c16-983c-49d8-a3da-e826cbe6fba3 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:08.616784 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-42af1c16-983c-49d8-a3da-e826cbe6fba3 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:08.664098 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-0f5967d6-d348-4672-a67f-35df79853e68 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:08.672283 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-0f5967d6-d348-4672-a67f-35df79853e68 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715" status: 200 len: 1735 microversion: 2.1 time: 0.157815 Sep 30 19:35:08.672878 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 352/668] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:08 2022] GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:35:08.752718 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-42af1c16-983c-49d8-a3da-e826cbe6fba3 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:08.760510 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-42af1c16-983c-49d8-a3da-e826cbe6fba3 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1569 microversion: 2.1 time: 0.157892 Sep 30 19:35:08.761114 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 317/669] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:08 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:35:09.696610 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-c00f88aa-d8d1-4d65-bdc1-a118feec4fd6 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:09.697216 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-c00f88aa-d8d1-4d65-bdc1-a118feec4fd6 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:09.703580 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c00f88aa-d8d1-4d65-bdc1-a118feec4fd6 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:09.704059 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c00f88aa-d8d1-4d65-bdc1-a118feec4fd6 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:09.704536 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c00f88aa-d8d1-4d65-bdc1-a118feec4fd6 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:09.705217 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c00f88aa-d8d1-4d65-bdc1-a118feec4fd6 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:09.705669 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c00f88aa-d8d1-4d65-bdc1-a118feec4fd6 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:09.706089 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c00f88aa-d8d1-4d65-bdc1-a118feec4fd6 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:09.784947 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-95620889-8042-4a75-812e-ba8e545bacb0 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:09.785593 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-95620889-8042-4a75-812e-ba8e545bacb0 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:09.791975 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-95620889-8042-4a75-812e-ba8e545bacb0 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:09.792486 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-95620889-8042-4a75-812e-ba8e545bacb0 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:09.792921 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-95620889-8042-4a75-812e-ba8e545bacb0 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:09.793617 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-95620889-8042-4a75-812e-ba8e545bacb0 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:09.794096 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-95620889-8042-4a75-812e-ba8e545bacb0 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:09.794495 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-95620889-8042-4a75-812e-ba8e545bacb0 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:09.837232 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-c00f88aa-d8d1-4d65-bdc1-a118feec4fd6 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:09.845374 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-c00f88aa-d8d1-4d65-bdc1-a118feec4fd6 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715" status: 200 len: 1715 microversion: 2.1 time: 0.153175 Sep 30 19:35:09.846144 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 353/670] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:09 2022] GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715 => generated 1715 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:09.908646 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-7f3e3fec-df44-421a-96e7-b8fb9731fd83 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:09.909175 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-7f3e3fec-df44-421a-96e7-b8fb9731fd83 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:09.915184 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7f3e3fec-df44-421a-96e7-b8fb9731fd83 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:09.915668 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7f3e3fec-df44-421a-96e7-b8fb9731fd83 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:09.916105 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7f3e3fec-df44-421a-96e7-b8fb9731fd83 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:09.916826 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7f3e3fec-df44-421a-96e7-b8fb9731fd83 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:09.917283 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7f3e3fec-df44-421a-96e7-b8fb9731fd83 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:09.917710 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7f3e3fec-df44-421a-96e7-b8fb9731fd83 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:09.925902 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-95620889-8042-4a75-812e-ba8e545bacb0 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:09.935699 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-95620889-8042-4a75-812e-ba8e545bacb0 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1569 microversion: 2.1 time: 0.154955 Sep 30 19:35:09.936265 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 318/671] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:09 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:35:10.043608 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.wsgi [None req-7f3e3fec-df44-421a-96e7-b8fb9731fd83 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] HTTP exception thrown: Cannot 'detach_volume' instance 99020333-8572-4b29-bfa8-d5961bcde715 while it is in vm_state rescued Sep 30 19:35:10.045658 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-7f3e3fec-df44-421a-96e7-b8fb9731fd83 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Request method failure captured: Sep 30 19:35:10.045658 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: request: DELETE /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715/os-volume_attachments/e29cd59a-1410-41be-ad01-d23ec3d14174 HTTP/1.1 Sep 30 19:35:10.045658 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Accept: application/json Sep 30 19:35:10.045658 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Accept-Encoding: identity Sep 30 19:35:10.045658 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Connection: close Sep 30 19:35:10.045658 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Content-Length: 0 Sep 30 19:35:10.045658 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Content-Type: application/json Sep 30 19:35:10.045658 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Host: 10.222.0.17 Sep 30 19:35:10.045658 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Openstack-System-Scope: None Sep 30 19:35:10.045658 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: User-Agent: python-urllib3/1.26.12 Sep 30 19:35:10.045658 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Auth-Token: gAAAAABjN0OLY5VUOI52bt3J_Dc8WpYWhiT0R61qetUr3OqzHkN-xal7RFSGHLx8a-oxcImL0Kgnf7Pk8IY6K4zB9sLscM3atT-JC4PMbFzZy3-3CihN1VE_98RxWRix6-oQ90T5ltyX81-Z_CCz7FqHItP5YzDUiDTxr5fpifGluWDXW2hKMss Sep 30 19:35:10.045658 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Domain-Id: None Sep 30 19:35:10.045658 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Domain-Name: None Sep 30 19:35:10.045658 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Identity-Status: Confirmed Sep 30 19:35:10.045658 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Is-Admin-Project: True Sep 30 19:35:10.045658 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Domain-Id: default Sep 30 19:35:10.045658 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Domain-Name: Default Sep 30 19:35:10.045658 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Id: de44d50bb79d48189cd74cad8079e01f Sep 30 19:35:10.045658 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1953016591 Sep 30 19:35:10.045658 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Role: member,reader Sep 30 19:35:10.045658 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Roles: member,reader Sep 30 19:35:10.047233 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/de44d50bb79d48189cd74cad8079e01f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/de44d50bb79d48189cd74cad8079e01f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/de44d50bb79d48189cd74cad8079e01f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_de44d50bb79d48189cd74cad8079e01f"}]}] Sep 30 19:35:10.047233 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1953016591 Sep 30 19:35:10.047233 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant-Id: de44d50bb79d48189cd74cad8079e01f Sep 30 19:35:10.047233 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1953016591 Sep 30 19:35:10.047233 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User: tempest-ServerRescueNegativeTestJSON-1953016591-project Sep 30 19:35:10.047233 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Domain-Id: default Sep 30 19:35:10.047233 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Domain-Name: Default Sep 30 19:35:10.047233 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Id: 624738daa9db4aff885d71ea2d65fb26 Sep 30 19:35:10.047233 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1953016591-project Sep 30 19:35:10.047233 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: method: > Sep 30 19:35:10.047233 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: exception: Cannot 'detach_volume' instance 99020333-8572-4b29-bfa8-d5961bcde715 while it is in vm_state rescued Sep 30 19:35:10.048012 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: action_args: {'server_id': '99020333-8572-4b29-bfa8-d5961bcde715', 'id': 'e29cd59a-1410-41be-ad01-d23ec3d14174'} Sep 30 19:35:10.048012 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:35:10.048012 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:35:10.048012 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 30 19:35:10.048012 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 30 19:35:10.048012 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 30 19:35:10.048012 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 30 19:35:10.048012 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 30 19:35:10.048012 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 30 19:35:10.048012 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 99020333-8572-4b29-bfa8-d5961bcde715 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 30 19:35:10.048012 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:35:10.048012 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:35:10.048012 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:35:10.048012 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:35:10.048012 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:35:10.048012 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:35:10.048012 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:35:10.048012 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:35:10.048012 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:35:10.048012 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:35:10.049534 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 30 19:35:10.049534 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 30 19:35:10.049534 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 30 19:35:10.049534 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 30 19:35:10.049534 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 99020333-8572-4b29-bfa8-d5961bcde715 while it is in vm_state rescued Sep 30 19:35:10.049534 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:35:10.049534 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:35:10.049534 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:35:10.049534 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:35:10.049534 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:35:10.049534 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:35:10.049534 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:35:10.049534 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:35:10.049534 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 99020333-8572-4b29-bfa8-d5961bcde715 while it is in vm_state rescued Sep 30 19:35:10.049534 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:35:10.049534 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-7f3e3fec-df44-421a-96e7-b8fb9731fd83 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Returning 409 to user: Cannot 'detach_volume' instance 99020333-8572-4b29-bfa8-d5961bcde715 while it is in vm_state rescued {{(pid=120649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:35:10.050799 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-7f3e3fec-df44-421a-96e7-b8fb9731fd83 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "DELETE /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715/os-volume_attachments/e29cd59a-1410-41be-ad01-d23ec3d14174" status: 409 len: 152 microversion: 2.1 time: 0.142702 Sep 30 19:35:10.050799 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 354/672] 10.222.0.17 () {58 vars in 1416 bytes} [Fri Sep 30 19:35:09 2022] DELETE /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715/os-volume_attachments/e29cd59a-1410-41be-ad01-d23ec3d14174 => generated 152 bytes in 144 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 30 19:35:10.056427 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-ad61c3b8-f257-49a0-815d-0a797bdfe840 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:35:10.056952 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-ad61c3b8-f257-49a0-815d-0a797bdfe840 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:10.062704 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ad61c3b8-f257-49a0-815d-0a797bdfe840 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:10.063182 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ad61c3b8-f257-49a0-815d-0a797bdfe840 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:10.063615 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ad61c3b8-f257-49a0-815d-0a797bdfe840 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:10.064309 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ad61c3b8-f257-49a0-815d-0a797bdfe840 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:10.064769 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ad61c3b8-f257-49a0-815d-0a797bdfe840 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:10.065191 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ad61c3b8-f257-49a0-815d-0a797bdfe840 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:10.128793 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-ad61c3b8-f257-49a0-815d-0a797bdfe840 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "POST /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715/action" status: 202 len: 0 microversion: 2.1 time: 0.076493 Sep 30 19:35:10.129394 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 319/673] 10.222.0.17 () {60 vars in 1278 bytes} [Fri Sep 30 19:35:10 2022] POST /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 30 19:35:10.137658 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-63e788b2-1bfb-40fd-8d2d-90ea41be3c03 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:10.139012 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-63e788b2-1bfb-40fd-8d2d-90ea41be3c03 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:10.145231 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-63e788b2-1bfb-40fd-8d2d-90ea41be3c03 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:10.145815 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-63e788b2-1bfb-40fd-8d2d-90ea41be3c03 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:10.146333 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-63e788b2-1bfb-40fd-8d2d-90ea41be3c03 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:10.147116 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-63e788b2-1bfb-40fd-8d2d-90ea41be3c03 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:10.147653 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-63e788b2-1bfb-40fd-8d2d-90ea41be3c03 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:10.148096 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-63e788b2-1bfb-40fd-8d2d-90ea41be3c03 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:10.307997 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-63e788b2-1bfb-40fd-8d2d-90ea41be3c03 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:10.316162 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-63e788b2-1bfb-40fd-8d2d-90ea41be3c03 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715" status: 200 len: 1723 microversion: 2.1 time: 0.182267 Sep 30 19:35:10.316745 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 355/674] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:10 2022] GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:10.960246 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-464ab6e2-f392-49ed-8c05-3c7d99f88c72 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:10.960966 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-464ab6e2-f392-49ed-8c05-3c7d99f88c72 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:10.963332 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=35 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:35:10.969019 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-464ab6e2-f392-49ed-8c05-3c7d99f88c72 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:10.969505 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-464ab6e2-f392-49ed-8c05-3c7d99f88c72 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:10.969939 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-464ab6e2-f392-49ed-8c05-3c7d99f88c72 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:10.970629 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-464ab6e2-f392-49ed-8c05-3c7d99f88c72 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:10.971078 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-464ab6e2-f392-49ed-8c05-3c7d99f88c72 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:10.971499 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-464ab6e2-f392-49ed-8c05-3c7d99f88c72 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:11.104529 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-464ab6e2-f392-49ed-8c05-3c7d99f88c72 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:11.112257 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-464ab6e2-f392-49ed-8c05-3c7d99f88c72 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1569 microversion: 2.1 time: 0.156894 Sep 30 19:35:11.112877 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 320/675] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:10 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:11.340010 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-24552641-ece5-4928-9604-f973813f930e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:11.340592 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-24552641-ece5-4928-9604-f973813f930e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:11.347012 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-24552641-ece5-4928-9604-f973813f930e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:11.347496 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-24552641-ece5-4928-9604-f973813f930e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:11.347928 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-24552641-ece5-4928-9604-f973813f930e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:11.348648 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-24552641-ece5-4928-9604-f973813f930e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:11.349099 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-24552641-ece5-4928-9604-f973813f930e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:11.349522 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-24552641-ece5-4928-9604-f973813f930e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:11.480600 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-24552641-ece5-4928-9604-f973813f930e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:11.488602 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-24552641-ece5-4928-9604-f973813f930e tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715" status: 200 len: 1723 microversion: 2.1 time: 0.152537 Sep 30 19:35:11.489157 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 356/676] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:11 2022] GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:12.136151 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-0f2ebbfa-4b66-4d05-a781-c7efe9ea5633 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:12.136717 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-0f2ebbfa-4b66-4d05-a781-c7efe9ea5633 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:12.143016 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0f2ebbfa-4b66-4d05-a781-c7efe9ea5633 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:12.143485 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0f2ebbfa-4b66-4d05-a781-c7efe9ea5633 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:12.143912 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0f2ebbfa-4b66-4d05-a781-c7efe9ea5633 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:12.144621 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0f2ebbfa-4b66-4d05-a781-c7efe9ea5633 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:12.145067 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0f2ebbfa-4b66-4d05-a781-c7efe9ea5633 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:12.145484 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0f2ebbfa-4b66-4d05-a781-c7efe9ea5633 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:12.277570 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-0f2ebbfa-4b66-4d05-a781-c7efe9ea5633 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:12.285664 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-0f2ebbfa-4b66-4d05-a781-c7efe9ea5633 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1569 microversion: 2.1 time: 0.153323 Sep 30 19:35:12.286247 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 321/677] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:12 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:12.512758 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-4972ca90-833b-4750-87fa-3df0d39aeb2b tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:12.513359 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-4972ca90-833b-4750-87fa-3df0d39aeb2b tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:12.519735 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4972ca90-833b-4750-87fa-3df0d39aeb2b tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:12.520214 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4972ca90-833b-4750-87fa-3df0d39aeb2b tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:12.520669 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4972ca90-833b-4750-87fa-3df0d39aeb2b tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:12.521999 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4972ca90-833b-4750-87fa-3df0d39aeb2b tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:12.522452 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4972ca90-833b-4750-87fa-3df0d39aeb2b tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:12.522873 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4972ca90-833b-4750-87fa-3df0d39aeb2b tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:12.650683 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-4972ca90-833b-4750-87fa-3df0d39aeb2b tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:12.658848 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-4972ca90-833b-4750-87fa-3df0d39aeb2b tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715" status: 200 len: 1723 microversion: 2.1 time: 0.149832 Sep 30 19:35:12.659613 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 357/678] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:12 2022] GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:13.309561 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-bc764c87-e5ba-45e6-80b9-026d5d573c02 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:13.310215 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-bc764c87-e5ba-45e6-80b9-026d5d573c02 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:13.316657 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bc764c87-e5ba-45e6-80b9-026d5d573c02 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:13.317144 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bc764c87-e5ba-45e6-80b9-026d5d573c02 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:13.317584 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bc764c87-e5ba-45e6-80b9-026d5d573c02 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:13.318275 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bc764c87-e5ba-45e6-80b9-026d5d573c02 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:13.318732 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bc764c87-e5ba-45e6-80b9-026d5d573c02 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:13.319157 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bc764c87-e5ba-45e6-80b9-026d5d573c02 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:13.450593 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-bc764c87-e5ba-45e6-80b9-026d5d573c02 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:13.458179 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-bc764c87-e5ba-45e6-80b9-026d5d573c02 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1569 microversion: 2.1 time: 0.152599 Sep 30 19:35:13.458766 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 322/679] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:13 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:13.682433 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-5d16887b-b153-4124-98b1-da77334c5548 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:13.682960 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-5d16887b-b153-4124-98b1-da77334c5548 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:13.689288 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5d16887b-b153-4124-98b1-da77334c5548 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:13.690102 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5d16887b-b153-4124-98b1-da77334c5548 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:13.690537 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5d16887b-b153-4124-98b1-da77334c5548 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:13.691218 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5d16887b-b153-4124-98b1-da77334c5548 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:13.691700 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5d16887b-b153-4124-98b1-da77334c5548 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:13.692129 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5d16887b-b153-4124-98b1-da77334c5548 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:13.821611 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-5d16887b-b153-4124-98b1-da77334c5548 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:13.829748 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-5d16887b-b153-4124-98b1-da77334c5548 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715" status: 200 len: 1723 microversion: 2.1 time: 0.151221 Sep 30 19:35:13.830307 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 358/680] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:13 2022] GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:14.481638 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-b2d8d314-4269-4606-b911-98e6aaa80e3a tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:14.482251 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-b2d8d314-4269-4606-b911-98e6aaa80e3a tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:14.488582 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b2d8d314-4269-4606-b911-98e6aaa80e3a tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:14.489063 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b2d8d314-4269-4606-b911-98e6aaa80e3a tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:14.489497 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b2d8d314-4269-4606-b911-98e6aaa80e3a tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:14.490178 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b2d8d314-4269-4606-b911-98e6aaa80e3a tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:14.490637 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b2d8d314-4269-4606-b911-98e6aaa80e3a tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:14.491060 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b2d8d314-4269-4606-b911-98e6aaa80e3a tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:14.621588 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-b2d8d314-4269-4606-b911-98e6aaa80e3a tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:14.629270 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-b2d8d314-4269-4606-b911-98e6aaa80e3a tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1569 microversion: 2.1 time: 0.151545 Sep 30 19:35:14.629831 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 323/681] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:14 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:14.852764 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-1a227a51-779a-4e3e-bd68-581d0c3927f7 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:14.853376 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-1a227a51-779a-4e3e-bd68-581d0c3927f7 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:14.859688 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1a227a51-779a-4e3e-bd68-581d0c3927f7 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:14.860171 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1a227a51-779a-4e3e-bd68-581d0c3927f7 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:14.860646 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1a227a51-779a-4e3e-bd68-581d0c3927f7 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:14.861338 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1a227a51-779a-4e3e-bd68-581d0c3927f7 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:14.861790 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1a227a51-779a-4e3e-bd68-581d0c3927f7 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:14.862234 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1a227a51-779a-4e3e-bd68-581d0c3927f7 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:14.992786 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-1a227a51-779a-4e3e-bd68-581d0c3927f7 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:15.000942 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-1a227a51-779a-4e3e-bd68-581d0c3927f7 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715" status: 200 len: 1729 microversion: 2.1 time: 0.151918 Sep 30 19:35:15.001498 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 359/682] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:14 2022] GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:15.024040 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-52cfbee5-5ddb-4694-a3b6-ac39e83b289c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:15.024513 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-52cfbee5-5ddb-4694-a3b6-ac39e83b289c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:15.030550 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-52cfbee5-5ddb-4694-a3b6-ac39e83b289c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:15.031062 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-52cfbee5-5ddb-4694-a3b6-ac39e83b289c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:15.031503 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-52cfbee5-5ddb-4694-a3b6-ac39e83b289c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:15.032223 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-52cfbee5-5ddb-4694-a3b6-ac39e83b289c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:15.032711 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-52cfbee5-5ddb-4694-a3b6-ac39e83b289c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:15.033167 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-52cfbee5-5ddb-4694-a3b6-ac39e83b289c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:15.109550 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-52cfbee5-5ddb-4694-a3b6-ac39e83b289c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089311 Sep 30 19:35:15.110138 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 324/683] 10.222.0.17 () {58 vars in 1275 bytes} [Fri Sep 30 19:35:15 2022] GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:35:15.654314 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-06801212-b821-449e-9b3a-caa1f7dd0f86 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:15.654952 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-06801212-b821-449e-9b3a-caa1f7dd0f86 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:15.661094 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-06801212-b821-449e-9b3a-caa1f7dd0f86 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:15.661575 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-06801212-b821-449e-9b3a-caa1f7dd0f86 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:15.662012 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-06801212-b821-449e-9b3a-caa1f7dd0f86 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:15.662740 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-06801212-b821-449e-9b3a-caa1f7dd0f86 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:15.663192 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-06801212-b821-449e-9b3a-caa1f7dd0f86 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:15.663615 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-06801212-b821-449e-9b3a-caa1f7dd0f86 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:15.794885 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-06801212-b821-449e-9b3a-caa1f7dd0f86 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:15.803463 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-06801212-b821-449e-9b3a-caa1f7dd0f86 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1569 microversion: 2.1 time: 0.153574 Sep 30 19:35:15.804101 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 360/684] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:15 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:16.266773 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-3c0d34c5-5215-4d4b-8fc7-96991079c377 req-0570a803-245a-4e42-accc-0bacfecc575d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99020333-8572-4b29-bfa8-d5961bcde715", "tag": "21fca32a-5249-4344-9c8b-48685af3e0a7"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:35:16.276400 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-3c0d34c5-5215-4d4b-8fc7-96991079c377 req-0570a803-245a-4e42-accc-0bacfecc575d service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:16.277009 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-3c0d34c5-5215-4d4b-8fc7-96991079c377 req-0570a803-245a-4e42-accc-0bacfecc575d service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:16.277442 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-3c0d34c5-5215-4d4b-8fc7-96991079c377 req-0570a803-245a-4e42-accc-0bacfecc575d service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:16.289343 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-3c0d34c5-5215-4d4b-8fc7-96991079c377 req-0570a803-245a-4e42-accc-0bacfecc575d service nova] Creating event network-changed:21fca32a-5249-4344-9c8b-48685af3e0a7 for instance 99020333-8572-4b29-bfa8-d5961bcde715 on hv-cinder-86001 Sep 30 19:35:16.305925 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-3c0d34c5-5215-4d4b-8fc7-96991079c377 req-0570a803-245a-4e42-accc-0bacfecc575d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099674 Sep 30 19:35:16.306446 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 325/685] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:35:16.828659 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-010ea6f1-214a-4e61-b36d-59a0df0bb1b0 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:16.831068 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-010ea6f1-214a-4e61-b36d-59a0df0bb1b0 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:16.837691 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-010ea6f1-214a-4e61-b36d-59a0df0bb1b0 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:16.838454 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-010ea6f1-214a-4e61-b36d-59a0df0bb1b0 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:16.839104 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-010ea6f1-214a-4e61-b36d-59a0df0bb1b0 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:16.839887 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-010ea6f1-214a-4e61-b36d-59a0df0bb1b0 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:16.840505 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-010ea6f1-214a-4e61-b36d-59a0df0bb1b0 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:16.841018 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-010ea6f1-214a-4e61-b36d-59a0df0bb1b0 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:16.976170 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-010ea6f1-214a-4e61-b36d-59a0df0bb1b0 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:16.984006 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-010ea6f1-214a-4e61-b36d-59a0df0bb1b0 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1569 microversion: 2.1 time: 0.160631 Sep 30 19:35:16.984607 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 361/686] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:16 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:18.008171 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-8573c3f9-7ab2-4de9-96cd-1e956d018f9c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:18.008897 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-8573c3f9-7ab2-4de9-96cd-1e956d018f9c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:18.015435 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8573c3f9-7ab2-4de9-96cd-1e956d018f9c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:18.015915 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8573c3f9-7ab2-4de9-96cd-1e956d018f9c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:18.016345 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8573c3f9-7ab2-4de9-96cd-1e956d018f9c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:18.017115 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8573c3f9-7ab2-4de9-96cd-1e956d018f9c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:18.017565 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8573c3f9-7ab2-4de9-96cd-1e956d018f9c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:18.017985 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8573c3f9-7ab2-4de9-96cd-1e956d018f9c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:18.149989 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-8573c3f9-7ab2-4de9-96cd-1e956d018f9c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:18.157646 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-8573c3f9-7ab2-4de9-96cd-1e956d018f9c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1569 microversion: 2.1 time: 0.154322 Sep 30 19:35:18.158210 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 326/687] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:18 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:35:18.321867 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [req-4ba77047-a77d-436f-abc4-a7593e85400e req-876725d5-52c0-459b-8ba9-97677da79217 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99020333-8572-4b29-bfa8-d5961bcde715", "tag": "21fca32a-5249-4344-9c8b-48685af3e0a7"}]} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:35:18.331758 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-4ba77047-a77d-436f-abc4-a7593e85400e req-876725d5-52c0-459b-8ba9-97677da79217 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:18.332228 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-4ba77047-a77d-436f-abc4-a7593e85400e req-876725d5-52c0-459b-8ba9-97677da79217 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:18.332697 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-4ba77047-a77d-436f-abc4-a7593e85400e req-876725d5-52c0-459b-8ba9-97677da79217 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:18.344274 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.compute.server_external_events [req-4ba77047-a77d-436f-abc4-a7593e85400e req-876725d5-52c0-459b-8ba9-97677da79217 service nova] Creating event network-changed:21fca32a-5249-4344-9c8b-48685af3e0a7 for instance 99020333-8572-4b29-bfa8-d5961bcde715 on hv-cinder-86001 Sep 30 19:35:18.349284 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [req-4ba77047-a77d-436f-abc4-a7593e85400e req-876725d5-52c0-459b-8ba9-97677da79217 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031661 Sep 30 19:35:18.349938 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 362/688] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:35:19.181338 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-fc46de39-5d18-4e8e-af7e-9a209ac416be tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:19.181890 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-fc46de39-5d18-4e8e-af7e-9a209ac416be tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:19.188317 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fc46de39-5d18-4e8e-af7e-9a209ac416be tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:19.188829 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fc46de39-5d18-4e8e-af7e-9a209ac416be tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:19.189264 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fc46de39-5d18-4e8e-af7e-9a209ac416be tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:19.189954 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fc46de39-5d18-4e8e-af7e-9a209ac416be tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:19.190413 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fc46de39-5d18-4e8e-af7e-9a209ac416be tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:19.190840 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fc46de39-5d18-4e8e-af7e-9a209ac416be tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:19.317297 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-fc46de39-5d18-4e8e-af7e-9a209ac416be tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:19.325546 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-fc46de39-5d18-4e8e-af7e-9a209ac416be tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1569 microversion: 2.1 time: 0.148166 Sep 30 19:35:19.326111 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 327/689] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:19 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:20.350527 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-5b93cbf6-5b0a-4fe0-b3c6-f89d1907abd6 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:20.351771 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-5b93cbf6-5b0a-4fe0-b3c6-f89d1907abd6 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:20.357881 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5b93cbf6-5b0a-4fe0-b3c6-f89d1907abd6 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:20.358360 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5b93cbf6-5b0a-4fe0-b3c6-f89d1907abd6 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:20.358796 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5b93cbf6-5b0a-4fe0-b3c6-f89d1907abd6 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:20.359484 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5b93cbf6-5b0a-4fe0-b3c6-f89d1907abd6 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:20.359939 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5b93cbf6-5b0a-4fe0-b3c6-f89d1907abd6 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:20.360381 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5b93cbf6-5b0a-4fe0-b3c6-f89d1907abd6 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:20.491653 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-5b93cbf6-5b0a-4fe0-b3c6-f89d1907abd6 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:20.499282 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-5b93cbf6-5b0a-4fe0-b3c6-f89d1907abd6 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1569 microversion: 2.1 time: 0.153544 Sep 30 19:35:20.499834 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 363/690] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:20 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:35:21.522539 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-0feea809-8129-4f94-93a9-118a443fc07c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:21.523334 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-0feea809-8129-4f94-93a9-118a443fc07c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:21.529753 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0feea809-8129-4f94-93a9-118a443fc07c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:21.530228 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0feea809-8129-4f94-93a9-118a443fc07c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:21.530656 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0feea809-8129-4f94-93a9-118a443fc07c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:21.531335 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0feea809-8129-4f94-93a9-118a443fc07c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:21.531784 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0feea809-8129-4f94-93a9-118a443fc07c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:21.532204 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0feea809-8129-4f94-93a9-118a443fc07c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:21.658027 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-0feea809-8129-4f94-93a9-118a443fc07c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:21.666439 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-0feea809-8129-4f94-93a9-118a443fc07c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1569 microversion: 2.1 time: 0.148183 Sep 30 19:35:21.666998 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 328/691] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:21 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:22.560981 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-d6b6d218-54ec-4e41-915b-ed89179877d4 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:22.561474 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-d6b6d218-54ec-4e41-915b-ed89179877d4 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:22.567560 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d6b6d218-54ec-4e41-915b-ed89179877d4 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:22.568049 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d6b6d218-54ec-4e41-915b-ed89179877d4 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:22.568519 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d6b6d218-54ec-4e41-915b-ed89179877d4 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:22.569216 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d6b6d218-54ec-4e41-915b-ed89179877d4 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:22.570345 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d6b6d218-54ec-4e41-915b-ed89179877d4 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:22.570812 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d6b6d218-54ec-4e41-915b-ed89179877d4 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:22.650743 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.objects.instance [None req-d6b6d218-54ec-4e41-915b-ed89179877d4 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lazy-loading 'services' on Instance uuid 304c3216-3e08-4ea0-9ca4-ab7d78a952a9 {{(pid=120649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 30 19:35:22.690020 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-d9617a94-52fd-4166-b9b4-315a1ae12f99 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:22.690637 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-d9617a94-52fd-4166-b9b4-315a1ae12f99 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:22.697542 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d9617a94-52fd-4166-b9b4-315a1ae12f99 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:22.698032 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d9617a94-52fd-4166-b9b4-315a1ae12f99 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:22.698472 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d9617a94-52fd-4166-b9b4-315a1ae12f99 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:22.699166 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d9617a94-52fd-4166-b9b4-315a1ae12f99 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:22.699624 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d9617a94-52fd-4166-b9b4-315a1ae12f99 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:22.700051 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d9617a94-52fd-4166-b9b4-315a1ae12f99 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:22.765812 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-d6b6d218-54ec-4e41-915b-ed89179877d4 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "DELETE /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9/os-volume_attachments/f74a1448-33b0-4e4c-8441-565010aefc13" status: 202 len: 0 microversion: 2.1 time: 0.312962 Sep 30 19:35:22.766404 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 364/692] 10.222.0.17 () {58 vars in 1416 bytes} [Fri Sep 30 19:35:22 2022] DELETE /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9/os-volume_attachments/f74a1448-33b0-4e4c-8441-565010aefc13 => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 30 19:35:22.843682 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-d9617a94-52fd-4166-b9b4-315a1ae12f99 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:22.852151 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-d9617a94-52fd-4166-b9b4-315a1ae12f99 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1570 microversion: 2.1 time: 0.165964 Sep 30 19:35:22.852740 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 329/693] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:22 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1570 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:35:22.875598 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-685ab3f4-8b9f-4eec-867d-aaeec890f75c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:35:22.876288 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-685ab3f4-8b9f-4eec-867d-aaeec890f75c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:22.882551 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-685ab3f4-8b9f-4eec-867d-aaeec890f75c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:22.883043 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-685ab3f4-8b9f-4eec-867d-aaeec890f75c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:22.883490 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-685ab3f4-8b9f-4eec-867d-aaeec890f75c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:22.884186 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-685ab3f4-8b9f-4eec-867d-aaeec890f75c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:22.884674 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-685ab3f4-8b9f-4eec-867d-aaeec890f75c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:22.885102 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-685ab3f4-8b9f-4eec-867d-aaeec890f75c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:22.916295 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-685ab3f4-8b9f-4eec-867d-aaeec890f75c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120649) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 30 19:35:22.983908 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-685ab3f4-8b9f-4eec-867d-aaeec890f75c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "POST /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab/action" status: 202 len: 0 microversion: 2.1 time: 0.112695 Sep 30 19:35:22.984668 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 365/694] 10.222.0.17 () {60 vars in 1278 bytes} [Fri Sep 30 19:35:22 2022] POST /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 30 19:35:22.993222 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-81f9408d-d28a-43bd-a95d-9160f173fc13 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:22.993974 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-81f9408d-d28a-43bd-a95d-9160f173fc13 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:23.000352 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-81f9408d-d28a-43bd-a95d-9160f173fc13 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:23.001199 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-81f9408d-d28a-43bd-a95d-9160f173fc13 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:23.001711 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-81f9408d-d28a-43bd-a95d-9160f173fc13 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:23.002491 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-81f9408d-d28a-43bd-a95d-9160f173fc13 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:23.003024 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-81f9408d-d28a-43bd-a95d-9160f173fc13 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:23.003528 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-81f9408d-d28a-43bd-a95d-9160f173fc13 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:23.138204 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-81f9408d-d28a-43bd-a95d-9160f173fc13 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:23.145905 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-81f9408d-d28a-43bd-a95d-9160f173fc13 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1518 microversion: 2.1 time: 0.157070 Sep 30 19:35:23.146473 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 330/695] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:22 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:23.887915 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-12ff1738-40d7-4994-ba90-e8cfa02f96ad tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:35:23.896019 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-12ff1738-40d7-4994-ba90-e8cfa02f96ad tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:23.896872 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-12ff1738-40d7-4994-ba90-e8cfa02f96ad tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:23.897486 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-12ff1738-40d7-4994-ba90-e8cfa02f96ad tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:23.959757 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-12ff1738-40d7-4994-ba90-e8cfa02f96ad tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Going to try to stop instance {{(pid=120649) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 30 19:35:23.964831 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:35:24.001546 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-12ff1738-40d7-4994-ba90-e8cfa02f96ad tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "POST /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9/action" status: 202 len: 0 microversion: 2.1 time: 0.118226 Sep 30 19:35:24.002153 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 366/696] 10.222.0.17 () {60 vars in 1278 bytes} [Fri Sep 30 19:35:23 2022] POST /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 30 19:35:24.010576 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e4eb9fa4-66cc-421a-a816-5ed0a35debc5 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:24.011185 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-e4eb9fa4-66cc-421a-a816-5ed0a35debc5 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:24.018258 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e4eb9fa4-66cc-421a-a816-5ed0a35debc5 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:24.018862 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e4eb9fa4-66cc-421a-a816-5ed0a35debc5 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:24.019339 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e4eb9fa4-66cc-421a-a816-5ed0a35debc5 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:24.020235 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e4eb9fa4-66cc-421a-a816-5ed0a35debc5 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:24.021326 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e4eb9fa4-66cc-421a-a816-5ed0a35debc5 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:24.021784 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e4eb9fa4-66cc-421a-a816-5ed0a35debc5 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:24.159528 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-e4eb9fa4-66cc-421a-a816-5ed0a35debc5 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:24.169224 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-e4eb9fa4-66cc-421a-a816-5ed0a35debc5 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1677 microversion: 2.1 time: 0.162288 Sep 30 19:35:24.169794 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 331/697] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:24 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:24.170886 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-6cde8af6-52eb-4953-85f2-a03ea5be1f96 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:24.171592 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-6cde8af6-52eb-4953-85f2-a03ea5be1f96 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:24.177986 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6cde8af6-52eb-4953-85f2-a03ea5be1f96 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:24.178517 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6cde8af6-52eb-4953-85f2-a03ea5be1f96 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:24.178957 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6cde8af6-52eb-4953-85f2-a03ea5be1f96 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:24.179650 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6cde8af6-52eb-4953-85f2-a03ea5be1f96 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:24.180104 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6cde8af6-52eb-4953-85f2-a03ea5be1f96 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:24.180563 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6cde8af6-52eb-4953-85f2-a03ea5be1f96 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:24.315122 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-6cde8af6-52eb-4953-85f2-a03ea5be1f96 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:24.323278 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-6cde8af6-52eb-4953-85f2-a03ea5be1f96 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1520 microversion: 2.1 time: 0.156928 Sep 30 19:35:24.323841 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 367/698] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:24 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:35:25.006920 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-4e544815-f243-4f23-b652-246a553d8959 req-3acc593c-5540-4c33-9c34-ad75b035dee7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4d9e349-e05e-43c7-ac04-37d75ee740ab", "name": "network-vif-unplugged", "status": "completed", "tag": "b73129fe-b689-4fff-8b47-dd8833dbebb1"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:35:25.017723 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-4e544815-f243-4f23-b652-246a553d8959 req-3acc593c-5540-4c33-9c34-ad75b035dee7 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:25.018190 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-4e544815-f243-4f23-b652-246a553d8959 req-3acc593c-5540-4c33-9c34-ad75b035dee7 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:25.018607 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-4e544815-f243-4f23-b652-246a553d8959 req-3acc593c-5540-4c33-9c34-ad75b035dee7 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:25.030207 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-4e544815-f243-4f23-b652-246a553d8959 req-3acc593c-5540-4c33-9c34-ad75b035dee7 service nova] Creating event network-vif-unplugged:b73129fe-b689-4fff-8b47-dd8833dbebb1 for instance e4d9e349-e05e-43c7-ac04-37d75ee740ab on hv-cinder-86001 Sep 30 19:35:25.035793 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-4e544815-f243-4f23-b652-246a553d8959 req-3acc593c-5540-4c33-9c34-ad75b035dee7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092590 Sep 30 19:35:25.036410 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 332/699] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:35:25.192178 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-d9a032c1-75d3-4f1b-903b-eaf5b8eadc21 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:25.192810 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-d9a032c1-75d3-4f1b-903b-eaf5b8eadc21 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:25.199056 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d9a032c1-75d3-4f1b-903b-eaf5b8eadc21 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:25.199534 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d9a032c1-75d3-4f1b-903b-eaf5b8eadc21 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:25.199971 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d9a032c1-75d3-4f1b-903b-eaf5b8eadc21 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:25.200683 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d9a032c1-75d3-4f1b-903b-eaf5b8eadc21 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:25.201135 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d9a032c1-75d3-4f1b-903b-eaf5b8eadc21 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:25.201561 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d9a032c1-75d3-4f1b-903b-eaf5b8eadc21 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:25.326850 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-d9a032c1-75d3-4f1b-903b-eaf5b8eadc21 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:25.334523 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-d9a032c1-75d3-4f1b-903b-eaf5b8eadc21 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1677 microversion: 2.1 time: 0.146121 Sep 30 19:35:25.335082 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 368/700] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:25 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1677 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:25.347530 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-ad643db4-7964-4af8-ab95-f62ee710752e tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:25.348263 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-ad643db4-7964-4af8-ab95-f62ee710752e tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:25.355034 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ad643db4-7964-4af8-ab95-f62ee710752e tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:25.355521 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ad643db4-7964-4af8-ab95-f62ee710752e tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:25.355995 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ad643db4-7964-4af8-ab95-f62ee710752e tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:25.356722 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ad643db4-7964-4af8-ab95-f62ee710752e tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:25.357183 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ad643db4-7964-4af8-ab95-f62ee710752e tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:25.357614 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ad643db4-7964-4af8-ab95-f62ee710752e tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:25.379322 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:35:25.512511 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-ad643db4-7964-4af8-ab95-f62ee710752e tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:25.520084 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-ad643db4-7964-4af8-ab95-f62ee710752e tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1576 microversion: 2.1 time: 0.176758 Sep 30 19:35:25.520682 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 333/701] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:25 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1576 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:26.358944 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-b589e21d-739a-4baf-89da-849b9eb6ca72 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:26.359568 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-b589e21d-739a-4baf-89da-849b9eb6ca72 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:26.365910 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b589e21d-739a-4baf-89da-849b9eb6ca72 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:26.366398 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b589e21d-739a-4baf-89da-849b9eb6ca72 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:26.366829 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b589e21d-739a-4baf-89da-849b9eb6ca72 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:26.367513 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b589e21d-739a-4baf-89da-849b9eb6ca72 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:26.367964 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b589e21d-739a-4baf-89da-849b9eb6ca72 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:26.368402 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b589e21d-739a-4baf-89da-849b9eb6ca72 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:26.497834 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-b589e21d-739a-4baf-89da-849b9eb6ca72 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:26.505535 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-b589e21d-739a-4baf-89da-849b9eb6ca72 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1677 microversion: 2.1 time: 0.150481 Sep 30 19:35:26.506094 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 369/702] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:26 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:26.544126 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-14c77f0b-dc14-4592-b1df-30151bdf02a9 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:26.544765 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-14c77f0b-dc14-4592-b1df-30151bdf02a9 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:26.550951 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-14c77f0b-dc14-4592-b1df-30151bdf02a9 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:26.551424 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-14c77f0b-dc14-4592-b1df-30151bdf02a9 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:26.551853 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-14c77f0b-dc14-4592-b1df-30151bdf02a9 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:26.552557 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-14c77f0b-dc14-4592-b1df-30151bdf02a9 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:26.553008 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-14c77f0b-dc14-4592-b1df-30151bdf02a9 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:26.553429 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-14c77f0b-dc14-4592-b1df-30151bdf02a9 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:26.679810 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-14c77f0b-dc14-4592-b1df-30151bdf02a9 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:26.687398 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-14c77f0b-dc14-4592-b1df-30151bdf02a9 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1576 microversion: 2.1 time: 0.147129 Sep 30 19:35:26.687954 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 334/703] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:26 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1576 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:27.528258 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-5a37dde3-b039-4634-90eb-fe124a1cd7bb tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:27.528901 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-5a37dde3-b039-4634-90eb-fe124a1cd7bb tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:27.535460 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5a37dde3-b039-4634-90eb-fe124a1cd7bb tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:27.535942 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5a37dde3-b039-4634-90eb-fe124a1cd7bb tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:27.536394 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5a37dde3-b039-4634-90eb-fe124a1cd7bb tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:27.537091 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5a37dde3-b039-4634-90eb-fe124a1cd7bb tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:27.537545 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5a37dde3-b039-4634-90eb-fe124a1cd7bb tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:27.537974 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5a37dde3-b039-4634-90eb-fe124a1cd7bb tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:27.662165 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-5a37dde3-b039-4634-90eb-fe124a1cd7bb tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:27.670249 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-5a37dde3-b039-4634-90eb-fe124a1cd7bb tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1677 microversion: 2.1 time: 0.145838 Sep 30 19:35:27.670805 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 370/704] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:27 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1677 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:27.711449 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-1ba2f831-179d-4d9a-bd10-e866aeefb758 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:27.712086 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-1ba2f831-179d-4d9a-bd10-e866aeefb758 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:27.718442 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1ba2f831-179d-4d9a-bd10-e866aeefb758 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:27.718924 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1ba2f831-179d-4d9a-bd10-e866aeefb758 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:27.719361 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1ba2f831-179d-4d9a-bd10-e866aeefb758 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:27.720215 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1ba2f831-179d-4d9a-bd10-e866aeefb758 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:27.720542 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1ba2f831-179d-4d9a-bd10-e866aeefb758 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:27.720970 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1ba2f831-179d-4d9a-bd10-e866aeefb758 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:27.850647 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-1ba2f831-179d-4d9a-bd10-e866aeefb758 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:27.858954 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-1ba2f831-179d-4d9a-bd10-e866aeefb758 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1576 microversion: 2.1 time: 0.151908 Sep 30 19:35:27.859521 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 335/705] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:27 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:28.693126 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-528ac278-1ca9-4c3f-86f8-3e1a14b62c49 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:28.693758 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-528ac278-1ca9-4c3f-86f8-3e1a14b62c49 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:28.696145 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:35:28.701280 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-528ac278-1ca9-4c3f-86f8-3e1a14b62c49 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:28.701759 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-528ac278-1ca9-4c3f-86f8-3e1a14b62c49 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:28.702192 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-528ac278-1ca9-4c3f-86f8-3e1a14b62c49 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:28.702875 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-528ac278-1ca9-4c3f-86f8-3e1a14b62c49 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:28.703325 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-528ac278-1ca9-4c3f-86f8-3e1a14b62c49 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:28.703741 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-528ac278-1ca9-4c3f-86f8-3e1a14b62c49 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:28.831069 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-528ac278-1ca9-4c3f-86f8-3e1a14b62c49 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:28.839238 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-528ac278-1ca9-4c3f-86f8-3e1a14b62c49 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1677 microversion: 2.1 time: 0.149973 Sep 30 19:35:28.839854 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 371/706] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:28 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:28.881801 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-568ed872-e927-4b70-a31d-513cd20e9ce4 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:28.882443 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-568ed872-e927-4b70-a31d-513cd20e9ce4 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:28.888808 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-568ed872-e927-4b70-a31d-513cd20e9ce4 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:28.889290 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-568ed872-e927-4b70-a31d-513cd20e9ce4 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:28.889724 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-568ed872-e927-4b70-a31d-513cd20e9ce4 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:28.890416 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-568ed872-e927-4b70-a31d-513cd20e9ce4 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:28.890867 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-568ed872-e927-4b70-a31d-513cd20e9ce4 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:28.891292 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-568ed872-e927-4b70-a31d-513cd20e9ce4 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:29.019603 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-568ed872-e927-4b70-a31d-513cd20e9ce4 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:29.027836 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-568ed872-e927-4b70-a31d-513cd20e9ce4 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1576 microversion: 2.1 time: 0.149878 Sep 30 19:35:29.028413 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 336/707] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:28 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:29.863183 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-d2c2e7ef-184f-4afd-ad5e-ffd1aaedb432 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:29.863791 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-d2c2e7ef-184f-4afd-ad5e-ffd1aaedb432 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:29.870248 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d2c2e7ef-184f-4afd-ad5e-ffd1aaedb432 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:29.870733 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d2c2e7ef-184f-4afd-ad5e-ffd1aaedb432 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:29.871172 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d2c2e7ef-184f-4afd-ad5e-ffd1aaedb432 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:29.871857 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d2c2e7ef-184f-4afd-ad5e-ffd1aaedb432 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:29.872314 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d2c2e7ef-184f-4afd-ad5e-ffd1aaedb432 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:29.872764 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d2c2e7ef-184f-4afd-ad5e-ffd1aaedb432 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:29.997049 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-d2c2e7ef-184f-4afd-ad5e-ffd1aaedb432 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:30.004560 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-d2c2e7ef-184f-4afd-ad5e-ffd1aaedb432 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1677 microversion: 2.1 time: 0.145270 Sep 30 19:35:30.005126 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 372/708] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:29 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1677 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:30.051699 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-678f3395-030f-4332-8fb0-8122a1206f35 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:30.052330 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-678f3395-030f-4332-8fb0-8122a1206f35 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:30.059259 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-678f3395-030f-4332-8fb0-8122a1206f35 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:30.059730 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-678f3395-030f-4332-8fb0-8122a1206f35 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:30.060159 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-678f3395-030f-4332-8fb0-8122a1206f35 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:30.060869 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-678f3395-030f-4332-8fb0-8122a1206f35 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:30.061316 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-678f3395-030f-4332-8fb0-8122a1206f35 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:30.061736 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-678f3395-030f-4332-8fb0-8122a1206f35 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:30.191525 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-678f3395-030f-4332-8fb0-8122a1206f35 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:30.199188 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-678f3395-030f-4332-8fb0-8122a1206f35 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1576 microversion: 2.1 time: 0.151344 Sep 30 19:35:30.199760 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 337/709] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:30 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:31.027660 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-2b792a36-615f-443f-a7cd-5249d5cb61c0 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:31.028261 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-2b792a36-615f-443f-a7cd-5249d5cb61c0 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:31.034970 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2b792a36-615f-443f-a7cd-5249d5cb61c0 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:31.035443 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2b792a36-615f-443f-a7cd-5249d5cb61c0 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:31.035873 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2b792a36-615f-443f-a7cd-5249d5cb61c0 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:31.036578 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2b792a36-615f-443f-a7cd-5249d5cb61c0 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:31.037030 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2b792a36-615f-443f-a7cd-5249d5cb61c0 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:31.037450 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2b792a36-615f-443f-a7cd-5249d5cb61c0 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:31.167222 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-2b792a36-615f-443f-a7cd-5249d5cb61c0 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:31.174880 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-2b792a36-615f-443f-a7cd-5249d5cb61c0 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1677 microversion: 2.1 time: 0.151082 Sep 30 19:35:31.175446 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 373/710] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:31 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:31.221433 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-6c0136ef-1b8c-4c61-acbc-a1839032e633 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:31.222039 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-6c0136ef-1b8c-4c61-acbc-a1839032e633 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:31.228811 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6c0136ef-1b8c-4c61-acbc-a1839032e633 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:31.229298 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6c0136ef-1b8c-4c61-acbc-a1839032e633 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:31.229730 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6c0136ef-1b8c-4c61-acbc-a1839032e633 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:31.230563 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6c0136ef-1b8c-4c61-acbc-a1839032e633 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:31.231020 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6c0136ef-1b8c-4c61-acbc-a1839032e633 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:31.231441 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6c0136ef-1b8c-4c61-acbc-a1839032e633 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:31.359645 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-6c0136ef-1b8c-4c61-acbc-a1839032e633 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:31.368018 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-6c0136ef-1b8c-4c61-acbc-a1839032e633 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1576 microversion: 2.1 time: 0.150424 Sep 30 19:35:31.368618 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 338/711] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:31 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:32.198812 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-b52c7496-430c-4836-b285-3bdb5452a6b7 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:32.199467 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-b52c7496-430c-4836-b285-3bdb5452a6b7 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:32.205738 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b52c7496-430c-4836-b285-3bdb5452a6b7 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:32.206217 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b52c7496-430c-4836-b285-3bdb5452a6b7 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:32.206654 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b52c7496-430c-4836-b285-3bdb5452a6b7 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:32.207342 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b52c7496-430c-4836-b285-3bdb5452a6b7 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:32.207795 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b52c7496-430c-4836-b285-3bdb5452a6b7 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:32.208218 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b52c7496-430c-4836-b285-3bdb5452a6b7 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:32.335920 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-b52c7496-430c-4836-b285-3bdb5452a6b7 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:32.344312 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-b52c7496-430c-4836-b285-3bdb5452a6b7 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1677 microversion: 2.1 time: 0.149983 Sep 30 19:35:32.344913 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 374/712] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:32 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:32.390867 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-817f4406-250c-4e96-b74c-0ac8841cde2c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:32.391475 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-817f4406-250c-4e96-b74c-0ac8841cde2c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:32.398684 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-817f4406-250c-4e96-b74c-0ac8841cde2c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:32.399166 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-817f4406-250c-4e96-b74c-0ac8841cde2c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:32.399596 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-817f4406-250c-4e96-b74c-0ac8841cde2c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:32.400310 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-817f4406-250c-4e96-b74c-0ac8841cde2c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:32.400787 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-817f4406-250c-4e96-b74c-0ac8841cde2c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:32.401210 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-817f4406-250c-4e96-b74c-0ac8841cde2c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:32.533002 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-817f4406-250c-4e96-b74c-0ac8841cde2c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:32.540960 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-817f4406-250c-4e96-b74c-0ac8841cde2c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1576 microversion: 2.1 time: 0.153902 Sep 30 19:35:32.541530 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 339/713] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:32 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:33.366989 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-c91473b0-6ac0-409e-8e58-ef463e7caeaa tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:33.367529 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-c91473b0-6ac0-409e-8e58-ef463e7caeaa tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:33.374013 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c91473b0-6ac0-409e-8e58-ef463e7caeaa tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:33.374492 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c91473b0-6ac0-409e-8e58-ef463e7caeaa tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:33.374926 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c91473b0-6ac0-409e-8e58-ef463e7caeaa tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:33.375611 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c91473b0-6ac0-409e-8e58-ef463e7caeaa tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:33.376066 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c91473b0-6ac0-409e-8e58-ef463e7caeaa tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:33.376512 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c91473b0-6ac0-409e-8e58-ef463e7caeaa tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:33.502550 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-c91473b0-6ac0-409e-8e58-ef463e7caeaa tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:33.510145 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-c91473b0-6ac0-409e-8e58-ef463e7caeaa tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1677 microversion: 2.1 time: 0.147099 Sep 30 19:35:33.510703 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 375/714] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:33 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:33.563647 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-0f4261dc-1549-46ce-bfa2-ebfabf59520d tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:33.564256 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-0f4261dc-1549-46ce-bfa2-ebfabf59520d tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:33.570608 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0f4261dc-1549-46ce-bfa2-ebfabf59520d tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:33.571089 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0f4261dc-1549-46ce-bfa2-ebfabf59520d tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:33.571522 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0f4261dc-1549-46ce-bfa2-ebfabf59520d tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:33.572205 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0f4261dc-1549-46ce-bfa2-ebfabf59520d tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:33.572692 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0f4261dc-1549-46ce-bfa2-ebfabf59520d tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:33.573124 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0f4261dc-1549-46ce-bfa2-ebfabf59520d tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:33.702896 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-0f4261dc-1549-46ce-bfa2-ebfabf59520d tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:33.710857 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-0f4261dc-1549-46ce-bfa2-ebfabf59520d tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1576 microversion: 2.1 time: 0.151083 Sep 30 19:35:33.711419 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 340/715] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:33 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:34.533468 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-0293852d-03ad-4184-a972-5711c20093a6 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:34.534100 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-0293852d-03ad-4184-a972-5711c20093a6 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:34.541104 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0293852d-03ad-4184-a972-5711c20093a6 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:34.541596 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0293852d-03ad-4184-a972-5711c20093a6 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:34.542033 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0293852d-03ad-4184-a972-5711c20093a6 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:34.542719 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0293852d-03ad-4184-a972-5711c20093a6 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:34.543174 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0293852d-03ad-4184-a972-5711c20093a6 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:34.543627 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0293852d-03ad-4184-a972-5711c20093a6 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:34.672330 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-0293852d-03ad-4184-a972-5711c20093a6 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:34.679917 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-0293852d-03ad-4184-a972-5711c20093a6 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1677 microversion: 2.1 time: 0.150321 Sep 30 19:35:34.680516 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 376/716] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:34 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:35:34.733953 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-b109ec40-6c5d-468a-b887-d7b69bc7027c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:34.734566 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-b109ec40-6c5d-468a-b887-d7b69bc7027c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:34.740967 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b109ec40-6c5d-468a-b887-d7b69bc7027c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:34.741448 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b109ec40-6c5d-468a-b887-d7b69bc7027c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:34.741903 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b109ec40-6c5d-468a-b887-d7b69bc7027c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:34.742598 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b109ec40-6c5d-468a-b887-d7b69bc7027c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:34.743050 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b109ec40-6c5d-468a-b887-d7b69bc7027c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:34.743473 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b109ec40-6c5d-468a-b887-d7b69bc7027c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:34.870006 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-b109ec40-6c5d-468a-b887-d7b69bc7027c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:34.877841 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-b109ec40-6c5d-468a-b887-d7b69bc7027c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1576 microversion: 2.1 time: 0.147742 Sep 30 19:35:34.878408 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 341/717] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:34 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1576 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:35.703732 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-0d232cdf-e7f8-4825-a58e-6135678d16aa tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:35.704344 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-0d232cdf-e7f8-4825-a58e-6135678d16aa tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:35.711455 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0d232cdf-e7f8-4825-a58e-6135678d16aa tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:35.711938 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0d232cdf-e7f8-4825-a58e-6135678d16aa tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:35.712391 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0d232cdf-e7f8-4825-a58e-6135678d16aa tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:35.713099 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0d232cdf-e7f8-4825-a58e-6135678d16aa tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:35.713556 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0d232cdf-e7f8-4825-a58e-6135678d16aa tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:35.713980 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0d232cdf-e7f8-4825-a58e-6135678d16aa tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:35.841172 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-0d232cdf-e7f8-4825-a58e-6135678d16aa tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:35.848715 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-0d232cdf-e7f8-4825-a58e-6135678d16aa tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1677 microversion: 2.1 time: 0.148849 Sep 30 19:35:35.849295 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 377/718] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:35 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:35.901480 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-5887aa0a-4de4-4a09-b946-eec0bf253c98 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:35.902081 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-5887aa0a-4de4-4a09-b946-eec0bf253c98 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:35.908566 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5887aa0a-4de4-4a09-b946-eec0bf253c98 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:35.909103 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5887aa0a-4de4-4a09-b946-eec0bf253c98 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:35.909787 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5887aa0a-4de4-4a09-b946-eec0bf253c98 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:35.910472 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5887aa0a-4de4-4a09-b946-eec0bf253c98 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:35.910920 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5887aa0a-4de4-4a09-b946-eec0bf253c98 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:35.911339 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5887aa0a-4de4-4a09-b946-eec0bf253c98 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:36.043602 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-5887aa0a-4de4-4a09-b946-eec0bf253c98 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:36.051196 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-5887aa0a-4de4-4a09-b946-eec0bf253c98 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1576 microversion: 2.1 time: 0.154037 Sep 30 19:35:36.051765 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 342/719] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:35 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:36.872497 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-5dc4a9f5-ef98-4c65-b699-1ca0a6763be9 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:36.873102 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-5dc4a9f5-ef98-4c65-b699-1ca0a6763be9 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:36.879494 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5dc4a9f5-ef98-4c65-b699-1ca0a6763be9 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:36.879988 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5dc4a9f5-ef98-4c65-b699-1ca0a6763be9 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:36.880456 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5dc4a9f5-ef98-4c65-b699-1ca0a6763be9 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:36.881151 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5dc4a9f5-ef98-4c65-b699-1ca0a6763be9 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:36.881636 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5dc4a9f5-ef98-4c65-b699-1ca0a6763be9 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:36.882064 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5dc4a9f5-ef98-4c65-b699-1ca0a6763be9 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:37.009070 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-5dc4a9f5-ef98-4c65-b699-1ca0a6763be9 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:37.016676 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-5dc4a9f5-ef98-4c65-b699-1ca0a6763be9 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1677 microversion: 2.1 time: 0.148038 Sep 30 19:35:37.017244 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 378/720] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:36 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:37.074018 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-1345eb09-da53-44d6-bab0-d02c1c75f0ea tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:37.074624 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-1345eb09-da53-44d6-bab0-d02c1c75f0ea tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:37.080698 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1345eb09-da53-44d6-bab0-d02c1c75f0ea tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:37.081183 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1345eb09-da53-44d6-bab0-d02c1c75f0ea tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:37.081618 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1345eb09-da53-44d6-bab0-d02c1c75f0ea tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:37.082303 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1345eb09-da53-44d6-bab0-d02c1c75f0ea tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:37.082757 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1345eb09-da53-44d6-bab0-d02c1c75f0ea tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:37.083182 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1345eb09-da53-44d6-bab0-d02c1c75f0ea tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:37.213126 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-1345eb09-da53-44d6-bab0-d02c1c75f0ea tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:37.220754 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-1345eb09-da53-44d6-bab0-d02c1c75f0ea tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1576 microversion: 2.1 time: 0.150532 Sep 30 19:35:37.221322 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 343/721] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:37 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:37.369241 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [req-85606278-6509-40d3-acea-881ab5e43bc0 req-8db076de-1904-456e-bab1-f34c04628b43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4d9e349-e05e-43c7-ac04-37d75ee740ab", "name": "network-vif-plugged", "status": "completed", "tag": "b73129fe-b689-4fff-8b47-dd8833dbebb1"}]} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:35:37.379956 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-85606278-6509-40d3-acea-881ab5e43bc0 req-8db076de-1904-456e-bab1-f34c04628b43 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:37.381177 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-85606278-6509-40d3-acea-881ab5e43bc0 req-8db076de-1904-456e-bab1-f34c04628b43 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:37.381620 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-85606278-6509-40d3-acea-881ab5e43bc0 req-8db076de-1904-456e-bab1-f34c04628b43 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:37.393113 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.compute.server_external_events [req-85606278-6509-40d3-acea-881ab5e43bc0 req-8db076de-1904-456e-bab1-f34c04628b43 service nova] Creating event network-vif-plugged:b73129fe-b689-4fff-8b47-dd8833dbebb1 for instance e4d9e349-e05e-43c7-ac04-37d75ee740ab on hv-cinder-86001 Sep 30 19:35:37.399026 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [req-85606278-6509-40d3-acea-881ab5e43bc0 req-8db076de-1904-456e-bab1-f34c04628b43 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033569 Sep 30 19:35:37.399842 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 379/722] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:35:38.039980 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-6c1b4623-6b47-46a1-85f2-44ac685f5c6e tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:38.040540 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-6c1b4623-6b47-46a1-85f2-44ac685f5c6e tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:38.046368 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6c1b4623-6b47-46a1-85f2-44ac685f5c6e tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:38.046851 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6c1b4623-6b47-46a1-85f2-44ac685f5c6e tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:38.047284 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6c1b4623-6b47-46a1-85f2-44ac685f5c6e tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:38.047994 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6c1b4623-6b47-46a1-85f2-44ac685f5c6e tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:38.048473 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6c1b4623-6b47-46a1-85f2-44ac685f5c6e tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:38.048896 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6c1b4623-6b47-46a1-85f2-44ac685f5c6e tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:38.177395 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-6c1b4623-6b47-46a1-85f2-44ac685f5c6e tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:38.185591 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-6c1b4623-6b47-46a1-85f2-44ac685f5c6e tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1677 microversion: 2.1 time: 0.149584 Sep 30 19:35:38.186154 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 344/723] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:38 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:38.245602 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-69c3bd66-6885-4950-a695-2a255cc8340b tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:38.246308 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-69c3bd66-6885-4950-a695-2a255cc8340b tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:38.252937 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-69c3bd66-6885-4950-a695-2a255cc8340b tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:38.253426 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-69c3bd66-6885-4950-a695-2a255cc8340b tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:38.253867 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-69c3bd66-6885-4950-a695-2a255cc8340b tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:38.254563 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-69c3bd66-6885-4950-a695-2a255cc8340b tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:38.255021 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-69c3bd66-6885-4950-a695-2a255cc8340b tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:38.255449 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-69c3bd66-6885-4950-a695-2a255cc8340b tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:38.386663 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-69c3bd66-6885-4950-a695-2a255cc8340b tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:38.394418 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-69c3bd66-6885-4950-a695-2a255cc8340b tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1576 microversion: 2.1 time: 0.153700 Sep 30 19:35:38.394981 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 380/724] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:38 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:38.915336 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-2a204104-37e6-48f4-b810-4ff93286473a tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:38.915875 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-2a204104-37e6-48f4-b810-4ff93286473a tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: e7a95413-7db3-443f-b375-3ddf2f3f6f1b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:38.921818 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2a204104-37e6-48f4-b810-4ff93286473a tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:38.922301 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2a204104-37e6-48f4-b810-4ff93286473a tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:38.922735 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2a204104-37e6-48f4-b810-4ff93286473a tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:38.923420 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2a204104-37e6-48f4-b810-4ff93286473a tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:38.923872 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2a204104-37e6-48f4-b810-4ff93286473a tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:38.924296 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2a204104-37e6-48f4-b810-4ff93286473a tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:38.947482 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-2a204104-37e6-48f4-b810-4ff93286473a tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/e7a95413-7db3-443f-b375-3ddf2f3f6f1b/ips" status: 200 len: 149 microversion: 2.1 time: 0.084152 Sep 30 19:35:38.948022 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 345/725] 10.222.0.17 () {58 vars in 1248 bytes} [Fri Sep 30 19:35:38 2022] GET /compute/v2.1/servers/e7a95413-7db3-443f-b375-3ddf2f3f6f1b/ips => generated 149 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:35:38.959634 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-1da59861-e5fb-483c-96ea-7bce95fa6e84 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2d7dd76d-f183-441b-8efa-2211585fc684"}} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:35:38.962605 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-1da59861-e5fb-483c-96ea-7bce95fa6e84 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: e7a95413-7db3-443f-b375-3ddf2f3f6f1b] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:38.968450 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1da59861-e5fb-483c-96ea-7bce95fa6e84 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:38.968935 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1da59861-e5fb-483c-96ea-7bce95fa6e84 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:38.969369 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1da59861-e5fb-483c-96ea-7bce95fa6e84 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:38.970060 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1da59861-e5fb-483c-96ea-7bce95fa6e84 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:38.970514 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1da59861-e5fb-483c-96ea-7bce95fa6e84 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:38.970939 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1da59861-e5fb-483c-96ea-7bce95fa6e84 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:39.048326 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.wsgi [None req-1da59861-e5fb-483c-96ea-7bce95fa6e84 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] HTTP exception thrown: Invalid volume: volume 2d7dd76d-f183-441b-8efa-2211585fc684 is already attached to instances: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d Sep 30 19:35:39.050314 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-1da59861-e5fb-483c-96ea-7bce95fa6e84 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Request method failure captured: Sep 30 19:35:39.050314 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: request: POST /compute/v2.1/servers/e7a95413-7db3-443f-b375-3ddf2f3f6f1b/os-volume_attachments HTTP/1.1 Sep 30 19:35:39.050314 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Accept: application/json Sep 30 19:35:39.050314 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Accept-Encoding: identity Sep 30 19:35:39.050314 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Connection: close Sep 30 19:35:39.050314 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Content-Length: 74 Sep 30 19:35:39.050314 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Content-Type: application/json Sep 30 19:35:39.050314 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Host: 10.222.0.17 Sep 30 19:35:39.050314 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Openstack-System-Scope: None Sep 30 19:35:39.050314 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: User-Agent: python-urllib3/1.26.12 Sep 30 19:35:39.050314 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Auth-Token: gAAAAABjN0ONqtIDYC2-7JPJhRMwDTFX77ua7wCzld6d05rw2OAypY6C9ruPlCf9je7iHOPQdEHBIS7fQsYNQwwCaWegqx7UtPiHvBb_B_GTauKCWL_cl9osIiSIgmJPV0ud6nFHwFaWS29rEhsSYVXTP0g-WZEwpi_MPh4YPjuB1sskH-bvyg0 Sep 30 19:35:39.050314 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Domain-Id: None Sep 30 19:35:39.050314 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Domain-Name: None Sep 30 19:35:39.050314 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Identity-Status: Confirmed Sep 30 19:35:39.050314 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Is-Admin-Project: True Sep 30 19:35:39.050314 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Domain-Id: default Sep 30 19:35:39.050314 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Domain-Name: Default Sep 30 19:35:39.050314 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Id: 612fb8a339e4478ba78bc5ef3b343b82 Sep 30 19:35:39.050314 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Name: tempest-AttachVolumeNegativeTest-1614355089 Sep 30 19:35:39.050314 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Role: member,reader Sep 30 19:35:39.050314 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Roles: member,reader Sep 30 19:35:39.051788 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/612fb8a339e4478ba78bc5ef3b343b82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/612fb8a339e4478ba78bc5ef3b343b82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/612fb8a339e4478ba78bc5ef3b343b82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_612fb8a339e4478ba78bc5ef3b343b82"}]}] Sep 30 19:35:39.051788 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant: tempest-AttachVolumeNegativeTest-1614355089 Sep 30 19:35:39.051788 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant-Id: 612fb8a339e4478ba78bc5ef3b343b82 Sep 30 19:35:39.051788 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1614355089 Sep 30 19:35:39.051788 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User: tempest-AttachVolumeNegativeTest-1614355089-project Sep 30 19:35:39.051788 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Domain-Id: default Sep 30 19:35:39.051788 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Domain-Name: Default Sep 30 19:35:39.051788 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Id: ccbdadc310fc4bf8a6679bcb39b34ff1 Sep 30 19:35:39.051788 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Name: tempest-AttachVolumeNegativeTest-1614355089-project Sep 30 19:35:39.051788 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Sep 30 19:35:39.051788 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: {"volumeAttachment": {"volumeId": "2d7dd76d-f183-441b-8efa-2211585fc684"}} Sep 30 19:35:39.051788 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: method: > Sep 30 19:35:39.052666 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: exception: Invalid volume: volume 2d7dd76d-f183-441b-8efa-2211585fc684 is already attached to instances: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d Sep 30 19:35:39.052666 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: action_args: {'server_id': 'e7a95413-7db3-443f-b375-3ddf2f3f6f1b', 'body': {'volumeAttachment': {'volumeId': '2d7dd76d-f183-441b-8efa-2211585fc684'}}} Sep 30 19:35:39.052666 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:35:39.052666 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:35:39.052666 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 30 19:35:39.052666 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 30 19:35:39.052666 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 30 19:35:39.052666 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 30 19:35:39.052666 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 30 19:35:39.052666 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 30 19:35:39.052666 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 30 19:35:39.052666 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 30 19:35:39.052666 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 30 19:35:39.052666 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 30 19:35:39.052666 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2d7dd76d-f183-441b-8efa-2211585fc684 is already attached to instances: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d Sep 30 19:35:39.052666 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:35:39.052666 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:35:39.052666 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:35:39.052666 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:35:39.053888 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:35:39.053888 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:35:39.053888 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:35:39.053888 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:35:39.053888 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:35:39.053888 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:35:39.053888 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 30 19:35:39.053888 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 30 19:35:39.053888 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 30 19:35:39.053888 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 30 19:35:39.053888 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 30 19:35:39.053888 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 30 19:35:39.053888 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 30 19:35:39.053888 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 30 19:35:39.053888 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2d7dd76d-f183-441b-8efa-2211585fc684 is already attached to instances: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d Sep 30 19:35:39.053888 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:35:39.053888 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:35:39.053888 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:35:39.053888 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:35:39.053888 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:35:39.055131 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:35:39.055131 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:35:39.055131 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:35:39.055131 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2d7dd76d-f183-441b-8efa-2211585fc684 is already attached to instances: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d Sep 30 19:35:39.055131 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:35:39.055131 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-1da59861-e5fb-483c-96ea-7bce95fa6e84 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Returning 400 to user: Invalid volume: volume 2d7dd76d-f183-441b-8efa-2211585fc684 is already attached to instances: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d {{(pid=120649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:35:39.055131 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-1da59861-e5fb-483c-96ea-7bce95fa6e84 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "POST /compute/v2.1/servers/e7a95413-7db3-443f-b375-3ddf2f3f6f1b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096092 Sep 30 19:35:39.055131 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 381/726] 10.222.0.17 () {60 vars in 1323 bytes} [Fri Sep 30 19:35:38 2022] POST /compute/v2.1/servers/e7a95413-7db3-443f-b375-3ddf2f3f6f1b/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 30 19:35:39.061557 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-4684c2f5-ea21-4c91-a1ab-58fe13682bc5 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:39.062052 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-4684c2f5-ea21-4c91-a1ab-58fe13682bc5 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: e7a95413-7db3-443f-b375-3ddf2f3f6f1b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:39.067782 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4684c2f5-ea21-4c91-a1ab-58fe13682bc5 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:39.068258 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4684c2f5-ea21-4c91-a1ab-58fe13682bc5 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:39.068722 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4684c2f5-ea21-4c91-a1ab-58fe13682bc5 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:39.069405 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4684c2f5-ea21-4c91-a1ab-58fe13682bc5 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:39.070383 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4684c2f5-ea21-4c91-a1ab-58fe13682bc5 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:39.070805 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4684c2f5-ea21-4c91-a1ab-58fe13682bc5 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:39.095990 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-4684c2f5-ea21-4c91-a1ab-58fe13682bc5 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: e7a95413-7db3-443f-b375-3ddf2f3f6f1b] Going to try to terminate instance {{(pid=120648) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 30 19:35:39.167667 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-4684c2f5-ea21-4c91-a1ab-58fe13682bc5 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e7a95413-7db3-443f-b375-3ddf2f3f6f1b" status: 204 len: 0 microversion: 2.1 time: 0.109514 Sep 30 19:35:39.168162 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 346/727] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 30 19:35:39 2022] DELETE /compute/v2.1/servers/e7a95413-7db3-443f-b375-3ddf2f3f6f1b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 30 19:35:39.180419 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-60f4bcbc-d29c-4508-a816-57268b7baed6 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:39.181129 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-60f4bcbc-d29c-4508-a816-57268b7baed6 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: e7a95413-7db3-443f-b375-3ddf2f3f6f1b] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:39.187996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-60f4bcbc-d29c-4508-a816-57268b7baed6 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:39.188509 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-60f4bcbc-d29c-4508-a816-57268b7baed6 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:39.188952 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-60f4bcbc-d29c-4508-a816-57268b7baed6 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:39.190779 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-60f4bcbc-d29c-4508-a816-57268b7baed6 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:39.191182 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-60f4bcbc-d29c-4508-a816-57268b7baed6 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:39.191994 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-60f4bcbc-d29c-4508-a816-57268b7baed6 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:39.210243 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-b771dfbf-b9b7-4a4d-b4c7-12d5e8d4cea7 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:39.211617 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-b771dfbf-b9b7-4a4d-b4c7-12d5e8d4cea7 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:39.217383 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b771dfbf-b9b7-4a4d-b4c7-12d5e8d4cea7 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:39.217869 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b771dfbf-b9b7-4a4d-b4c7-12d5e8d4cea7 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:39.218304 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b771dfbf-b9b7-4a4d-b4c7-12d5e8d4cea7 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:39.218998 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b771dfbf-b9b7-4a4d-b4c7-12d5e8d4cea7 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:39.219453 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b771dfbf-b9b7-4a4d-b4c7-12d5e8d4cea7 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:39.219873 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b771dfbf-b9b7-4a4d-b4c7-12d5e8d4cea7 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:39.324407 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-60f4bcbc-d29c-4508-a816-57268b7baed6 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:39.332265 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-60f4bcbc-d29c-4508-a816-57268b7baed6 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/e7a95413-7db3-443f-b375-3ddf2f3f6f1b" status: 200 len: 1682 microversion: 2.1 time: 0.155997 Sep 30 19:35:39.332866 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 382/728] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:39 2022] GET /compute/v2.1/servers/e7a95413-7db3-443f-b375-3ddf2f3f6f1b => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:39.350408 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-b771dfbf-b9b7-4a4d-b4c7-12d5e8d4cea7 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:39.358341 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-b771dfbf-b9b7-4a4d-b4c7-12d5e8d4cea7 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1677 microversion: 2.1 time: 0.152643 Sep 30 19:35:39.358908 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 347/729] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:39 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:35:39.416853 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-befa6e6b-eada-4f7e-a50e-b81470d28216 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:39.417462 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-befa6e6b-eada-4f7e-a50e-b81470d28216 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:39.423582 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-befa6e6b-eada-4f7e-a50e-b81470d28216 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:39.423991 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-befa6e6b-eada-4f7e-a50e-b81470d28216 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:39.424447 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-befa6e6b-eada-4f7e-a50e-b81470d28216 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:39.425135 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-befa6e6b-eada-4f7e-a50e-b81470d28216 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:39.425590 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-befa6e6b-eada-4f7e-a50e-b81470d28216 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:39.426012 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-befa6e6b-eada-4f7e-a50e-b81470d28216 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:39.431040 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:35:39.555494 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-befa6e6b-eada-4f7e-a50e-b81470d28216 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:39.563020 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-befa6e6b-eada-4f7e-a50e-b81470d28216 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1576 microversion: 2.1 time: 0.150016 Sep 30 19:35:39.563637 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 383/730] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:39 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:40.357632 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-ff76b8f2-69b4-4c71-8fbf-4b07a975579d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:40.358231 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-ff76b8f2-69b4-4c71-8fbf-4b07a975579d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: e7a95413-7db3-443f-b375-3ddf2f3f6f1b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:40.364896 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ff76b8f2-69b4-4c71-8fbf-4b07a975579d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:40.365367 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ff76b8f2-69b4-4c71-8fbf-4b07a975579d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:40.365791 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ff76b8f2-69b4-4c71-8fbf-4b07a975579d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:40.366473 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ff76b8f2-69b4-4c71-8fbf-4b07a975579d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:40.366942 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ff76b8f2-69b4-4c71-8fbf-4b07a975579d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:40.367359 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ff76b8f2-69b4-4c71-8fbf-4b07a975579d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:40.381765 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-a889eb1b-ef2f-4636-aa9d-791c96937989 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:40.382401 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-a889eb1b-ef2f-4636-aa9d-791c96937989 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:40.390263 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a889eb1b-ef2f-4636-aa9d-791c96937989 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:40.390749 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a889eb1b-ef2f-4636-aa9d-791c96937989 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:40.391183 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a889eb1b-ef2f-4636-aa9d-791c96937989 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:40.391878 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a889eb1b-ef2f-4636-aa9d-791c96937989 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:40.392330 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a889eb1b-ef2f-4636-aa9d-791c96937989 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:40.392780 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a889eb1b-ef2f-4636-aa9d-791c96937989 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:40.495864 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-ff76b8f2-69b4-4c71-8fbf-4b07a975579d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:40.499449 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:35:40.504701 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-ff76b8f2-69b4-4c71-8fbf-4b07a975579d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/e7a95413-7db3-443f-b375-3ddf2f3f6f1b" status: 200 len: 1682 microversion: 2.1 time: 0.150880 Sep 30 19:35:40.505371 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 348/731] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:40 2022] GET /compute/v2.1/servers/e7a95413-7db3-443f-b375-3ddf2f3f6f1b => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:40.526833 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-a889eb1b-ef2f-4636-aa9d-791c96937989 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:40.534689 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-a889eb1b-ef2f-4636-aa9d-791c96937989 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1677 microversion: 2.1 time: 0.156520 Sep 30 19:35:40.535240 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 384/732] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:40 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:35:40.681606 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-46566348-3861-464b-90c9-9180b58b0a2c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:40.682288 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-46566348-3861-464b-90c9-9180b58b0a2c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:40.688157 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-46566348-3861-464b-90c9-9180b58b0a2c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:40.688666 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-46566348-3861-464b-90c9-9180b58b0a2c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:40.689106 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-46566348-3861-464b-90c9-9180b58b0a2c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:40.689792 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-46566348-3861-464b-90c9-9180b58b0a2c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:40.690243 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-46566348-3861-464b-90c9-9180b58b0a2c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:40.690668 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-46566348-3861-464b-90c9-9180b58b0a2c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:40.825015 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-46566348-3861-464b-90c9-9180b58b0a2c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:40.837336 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-46566348-3861-464b-90c9-9180b58b0a2c tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1576 microversion: 2.1 time: 0.253850 Sep 30 19:35:40.838278 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 349/733] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:40 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1576 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:41.528113 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-98994e94-31c2-4994-8075-945b3962db1d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:41.528746 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-98994e94-31c2-4994-8075-945b3962db1d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: e7a95413-7db3-443f-b375-3ddf2f3f6f1b] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:41.535341 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-98994e94-31c2-4994-8075-945b3962db1d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:41.535826 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-98994e94-31c2-4994-8075-945b3962db1d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:41.536265 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-98994e94-31c2-4994-8075-945b3962db1d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:41.536980 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-98994e94-31c2-4994-8075-945b3962db1d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:41.537436 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-98994e94-31c2-4994-8075-945b3962db1d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:41.537863 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-98994e94-31c2-4994-8075-945b3962db1d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:41.557428 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-bf6227b7-bad3-4c0f-8b51-e2738a31ec3c tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:41.558061 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-bf6227b7-bad3-4c0f-8b51-e2738a31ec3c tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:41.560474 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:35:41.565804 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bf6227b7-bad3-4c0f-8b51-e2738a31ec3c tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:41.566292 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bf6227b7-bad3-4c0f-8b51-e2738a31ec3c tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:41.566729 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bf6227b7-bad3-4c0f-8b51-e2738a31ec3c tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:41.567421 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bf6227b7-bad3-4c0f-8b51-e2738a31ec3c tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:41.567880 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bf6227b7-bad3-4c0f-8b51-e2738a31ec3c tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:41.568335 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bf6227b7-bad3-4c0f-8b51-e2738a31ec3c tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:41.666892 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-98994e94-31c2-4994-8075-945b3962db1d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:41.674625 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-98994e94-31c2-4994-8075-945b3962db1d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/e7a95413-7db3-443f-b375-3ddf2f3f6f1b" status: 200 len: 1682 microversion: 2.1 time: 0.150360 Sep 30 19:35:41.675194 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 385/734] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:41 2022] GET /compute/v2.1/servers/e7a95413-7db3-443f-b375-3ddf2f3f6f1b => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:41.707130 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-bf6227b7-bad3-4c0f-8b51-e2738a31ec3c tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:41.714632 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-bf6227b7-bad3-4c0f-8b51-e2738a31ec3c tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1654 microversion: 2.1 time: 0.161028 Sep 30 19:35:41.715187 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 350/735] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:41 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1654 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:35:41.736664 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-f6de566c-fca7-46a9-a302-077cb35efb8f tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:35:41.742922 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f6de566c-fca7-46a9-a302-077cb35efb8f tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:41.743405 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f6de566c-fca7-46a9-a302-077cb35efb8f tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:41.743845 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f6de566c-fca7-46a9-a302-077cb35efb8f tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:41.765536 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-f6de566c-fca7-46a9-a302-077cb35efb8f tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Going to try to start instance {{(pid=120649) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 30 19:35:41.805585 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-f6de566c-fca7-46a9-a302-077cb35efb8f tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "POST /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9/action" status: 202 len: 0 microversion: 2.1 time: 0.072562 Sep 30 19:35:41.806176 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 386/736] 10.222.0.17 () {60 vars in 1278 bytes} [Fri Sep 30 19:35:41 2022] POST /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 30 19:35:41.814847 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-a0d52f13-6399-44ad-b96d-dfc57ebadc84 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:41.816247 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-a0d52f13-6399-44ad-b96d-dfc57ebadc84 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:41.822311 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a0d52f13-6399-44ad-b96d-dfc57ebadc84 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:41.822789 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a0d52f13-6399-44ad-b96d-dfc57ebadc84 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:41.823220 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a0d52f13-6399-44ad-b96d-dfc57ebadc84 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:41.823895 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a0d52f13-6399-44ad-b96d-dfc57ebadc84 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:41.824343 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a0d52f13-6399-44ad-b96d-dfc57ebadc84 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:41.824787 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a0d52f13-6399-44ad-b96d-dfc57ebadc84 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:41.862604 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-7e6bddd9-ee9a-43c5-a6ba-6971c3314045 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:41.863278 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-7e6bddd9-ee9a-43c5-a6ba-6971c3314045 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:41.870314 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7e6bddd9-ee9a-43c5-a6ba-6971c3314045 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:41.870795 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7e6bddd9-ee9a-43c5-a6ba-6971c3314045 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:41.871224 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7e6bddd9-ee9a-43c5-a6ba-6971c3314045 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:41.871914 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7e6bddd9-ee9a-43c5-a6ba-6971c3314045 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:41.872380 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7e6bddd9-ee9a-43c5-a6ba-6971c3314045 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:41.872808 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7e6bddd9-ee9a-43c5-a6ba-6971c3314045 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:41.962687 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-a0d52f13-6399-44ad-b96d-dfc57ebadc84 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:41.970359 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-a0d52f13-6399-44ad-b96d-dfc57ebadc84 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1663 microversion: 2.1 time: 0.159834 Sep 30 19:35:41.971428 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 351/737] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:41 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1663 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:42.082716 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-7e6bddd9-ee9a-43c5-a6ba-6971c3314045 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:42.091961 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-7e6bddd9-ee9a-43c5-a6ba-6971c3314045 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1563 microversion: 2.1 time: 0.234668 Sep 30 19:35:42.092565 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 387/738] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:41 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1563 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:35:42.698251 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-aeec9d24-6806-424e-b21f-af9c33be41dd tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:42.698793 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-aeec9d24-6806-424e-b21f-af9c33be41dd tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: e7a95413-7db3-443f-b375-3ddf2f3f6f1b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:42.705277 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-aeec9d24-6806-424e-b21f-af9c33be41dd tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:42.705764 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-aeec9d24-6806-424e-b21f-af9c33be41dd tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:42.706216 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-aeec9d24-6806-424e-b21f-af9c33be41dd tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:42.706903 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-aeec9d24-6806-424e-b21f-af9c33be41dd tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:42.707379 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-aeec9d24-6806-424e-b21f-af9c33be41dd tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:42.707787 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-aeec9d24-6806-424e-b21f-af9c33be41dd tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:42.843896 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-aeec9d24-6806-424e-b21f-af9c33be41dd tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:42.852796 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-aeec9d24-6806-424e-b21f-af9c33be41dd tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/e7a95413-7db3-443f-b375-3ddf2f3f6f1b" status: 200 len: 1682 microversion: 2.1 time: 0.158952 Sep 30 19:35:42.853423 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 352/739] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:42 2022] GET /compute/v2.1/servers/e7a95413-7db3-443f-b375-3ddf2f3f6f1b => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:42.994250 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-93720eb9-de52-4de9-9400-4f01082d1ddb tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:42.994861 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-93720eb9-de52-4de9-9400-4f01082d1ddb tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:42.996982 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 30 19:35:42.997131 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Fri Sep 30 19:35:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 (ip 10.222.0.17) !!! Sep 30 19:35:43.004137 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-93720eb9-de52-4de9-9400-4f01082d1ddb tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:43.004666 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-93720eb9-de52-4de9-9400-4f01082d1ddb tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:43.005113 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-93720eb9-de52-4de9-9400-4f01082d1ddb tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:43.005857 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-93720eb9-de52-4de9-9400-4f01082d1ddb tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:43.006317 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-93720eb9-de52-4de9-9400-4f01082d1ddb tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:43.006754 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-93720eb9-de52-4de9-9400-4f01082d1ddb tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:43.203394 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-93720eb9-de52-4de9-9400-4f01082d1ddb tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:43.212047 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-93720eb9-de52-4de9-9400-4f01082d1ddb tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1663 microversion: 2.1 time: 0.222279 Sep 30 19:35:43.225010 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 388/740] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:42 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1663 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:43.241680 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-4f5fe2c8-c6f9-4a48-b7c4-7a0ada7916fb req-e9b27dd8-c374-45f1-97a4-8676967da194 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7a95413-7db3-443f-b375-3ddf2f3f6f1b", "name": "network-vif-deleted", "tag": "7e028764-652a-4dc7-a348-c7dc9749c9b9"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:35:43.251162 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-4f5fe2c8-c6f9-4a48-b7c4-7a0ada7916fb req-e9b27dd8-c374-45f1-97a4-8676967da194 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:43.251726 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-4f5fe2c8-c6f9-4a48-b7c4-7a0ada7916fb req-e9b27dd8-c374-45f1-97a4-8676967da194 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:43.252233 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-4f5fe2c8-c6f9-4a48-b7c4-7a0ada7916fb req-e9b27dd8-c374-45f1-97a4-8676967da194 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:43.263235 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-4f5fe2c8-c6f9-4a48-b7c4-7a0ada7916fb req-e9b27dd8-c374-45f1-97a4-8676967da194 service nova] Creating event network-vif-deleted:7e028764-652a-4dc7-a348-c7dc9749c9b9 for instance e7a95413-7db3-443f-b375-3ddf2f3f6f1b on hv-cinder-86001 Sep 30 19:35:43.268361 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-4f5fe2c8-c6f9-4a48-b7c4-7a0ada7916fb req-e9b27dd8-c374-45f1-97a4-8676967da194 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088616 Sep 30 19:35:43.269066 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 353/741] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:35:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:35:43.878317 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-b778df2f-51cf-4294-a683-6af343da194c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:43.878922 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-b778df2f-51cf-4294-a683-6af343da194c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: e7a95413-7db3-443f-b375-3ddf2f3f6f1b] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:43.886476 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b778df2f-51cf-4294-a683-6af343da194c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:43.886968 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b778df2f-51cf-4294-a683-6af343da194c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:43.887698 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b778df2f-51cf-4294-a683-6af343da194c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:43.888562 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b778df2f-51cf-4294-a683-6af343da194c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:43.889168 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b778df2f-51cf-4294-a683-6af343da194c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:43.889446 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b778df2f-51cf-4294-a683-6af343da194c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:43.924707 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b778df2f-51cf-4294-a683-6af343da194c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:43.925185 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b778df2f-51cf-4294-a683-6af343da194c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:43.925652 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b778df2f-51cf-4294-a683-6af343da194c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:43.926089 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.objects.instance [None req-b778df2f-51cf-4294-a683-6af343da194c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lazy-loading 'fault' on Instance uuid e7a95413-7db3-443f-b375-3ddf2f3f6f1b {{(pid=120649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 30 19:35:43.979785 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-b778df2f-51cf-4294-a683-6af343da194c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:43.987443 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-b778df2f-51cf-4294-a683-6af343da194c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/e7a95413-7db3-443f-b375-3ddf2f3f6f1b" status: 200 len: 1332 microversion: 2.1 time: 0.114368 Sep 30 19:35:43.988192 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 389/742] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:43 2022] GET /compute/v2.1/servers/e7a95413-7db3-443f-b375-3ddf2f3f6f1b => generated 1332 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:44.237858 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-d95a9b9a-8fc1-4c56-8596-e6ee4c0ab22a tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:44.238549 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-d95a9b9a-8fc1-4c56-8596-e6ee4c0ab22a tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:44.244943 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d95a9b9a-8fc1-4c56-8596-e6ee4c0ab22a tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:44.245424 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d95a9b9a-8fc1-4c56-8596-e6ee4c0ab22a tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:44.245859 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d95a9b9a-8fc1-4c56-8596-e6ee4c0ab22a tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:44.246549 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d95a9b9a-8fc1-4c56-8596-e6ee4c0ab22a tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:44.247035 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d95a9b9a-8fc1-4c56-8596-e6ee4c0ab22a tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:44.247418 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d95a9b9a-8fc1-4c56-8596-e6ee4c0ab22a tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:44.389278 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-d95a9b9a-8fc1-4c56-8596-e6ee4c0ab22a tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:44.397773 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-d95a9b9a-8fc1-4c56-8596-e6ee4c0ab22a tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1667 microversion: 2.1 time: 0.164433 Sep 30 19:35:44.398854 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 354/743] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:44 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1667 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:45.010842 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-6a559dff-843c-450d-8c5b-447c4136b6f0 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:45.011422 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-6a559dff-843c-450d-8c5b-447c4136b6f0 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: e7a95413-7db3-443f-b375-3ddf2f3f6f1b] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:45.017813 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6a559dff-843c-450d-8c5b-447c4136b6f0 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:45.018286 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6a559dff-843c-450d-8c5b-447c4136b6f0 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:45.018717 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6a559dff-843c-450d-8c5b-447c4136b6f0 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:45.019394 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6a559dff-843c-450d-8c5b-447c4136b6f0 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:45.019842 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6a559dff-843c-450d-8c5b-447c4136b6f0 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:45.020269 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6a559dff-843c-450d-8c5b-447c4136b6f0 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:45.033347 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.wsgi [None req-6a559dff-843c-450d-8c5b-447c4136b6f0 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] HTTP exception thrown: Instance e7a95413-7db3-443f-b375-3ddf2f3f6f1b could not be found. Sep 30 19:35:45.035190 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-6a559dff-843c-450d-8c5b-447c4136b6f0 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Request method failure captured: Sep 30 19:35:45.035190 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: request: GET /compute/v2.1/servers/e7a95413-7db3-443f-b375-3ddf2f3f6f1b HTTP/1.1 Sep 30 19:35:45.035190 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Accept: application/json Sep 30 19:35:45.035190 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Accept-Encoding: identity Sep 30 19:35:45.035190 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Connection: close Sep 30 19:35:45.035190 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Content-Length: 0 Sep 30 19:35:45.035190 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Content-Type: application/json Sep 30 19:35:45.035190 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Host: 10.222.0.17 Sep 30 19:35:45.035190 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Openstack-System-Scope: None Sep 30 19:35:45.035190 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: User-Agent: python-urllib3/1.26.12 Sep 30 19:35:45.035190 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Auth-Token: gAAAAABjN0ONqtIDYC2-7JPJhRMwDTFX77ua7wCzld6d05rw2OAypY6C9ruPlCf9je7iHOPQdEHBIS7fQsYNQwwCaWegqx7UtPiHvBb_B_GTauKCWL_cl9osIiSIgmJPV0ud6nFHwFaWS29rEhsSYVXTP0g-WZEwpi_MPh4YPjuB1sskH-bvyg0 Sep 30 19:35:45.035190 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Domain-Id: None Sep 30 19:35:45.035190 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Domain-Name: None Sep 30 19:35:45.035190 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Identity-Status: Confirmed Sep 30 19:35:45.035190 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Is-Admin-Project: True Sep 30 19:35:45.035190 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Domain-Id: default Sep 30 19:35:45.035190 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Domain-Name: Default Sep 30 19:35:45.035190 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Id: 612fb8a339e4478ba78bc5ef3b343b82 Sep 30 19:35:45.035190 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Name: tempest-AttachVolumeNegativeTest-1614355089 Sep 30 19:35:45.035190 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Role: member,reader Sep 30 19:35:45.035190 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Roles: member,reader Sep 30 19:35:45.036732 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/612fb8a339e4478ba78bc5ef3b343b82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/612fb8a339e4478ba78bc5ef3b343b82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/612fb8a339e4478ba78bc5ef3b343b82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_612fb8a339e4478ba78bc5ef3b343b82"}]}] Sep 30 19:35:45.036732 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant: tempest-AttachVolumeNegativeTest-1614355089 Sep 30 19:35:45.036732 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant-Id: 612fb8a339e4478ba78bc5ef3b343b82 Sep 30 19:35:45.036732 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1614355089 Sep 30 19:35:45.036732 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User: tempest-AttachVolumeNegativeTest-1614355089-project Sep 30 19:35:45.036732 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Domain-Id: default Sep 30 19:35:45.036732 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Domain-Name: Default Sep 30 19:35:45.036732 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Id: ccbdadc310fc4bf8a6679bcb39b34ff1 Sep 30 19:35:45.036732 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Name: tempest-AttachVolumeNegativeTest-1614355089-project Sep 30 19:35:45.036732 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: method: > Sep 30 19:35:45.036732 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: exception: Instance e7a95413-7db3-443f-b375-3ddf2f3f6f1b could not be found. Sep 30 19:35:45.036732 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: action_args: {'id': 'e7a95413-7db3-443f-b375-3ddf2f3f6f1b'} Sep 30 19:35:45.037543 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:35:45.037543 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:35:45.037543 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 30 19:35:45.037543 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 30 19:35:45.037543 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 30 19:35:45.037543 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 30 19:35:45.037543 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 30 19:35:45.037543 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 30 19:35:45.037543 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 30 19:35:45.037543 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 30 19:35:45.037543 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7a95413-7db3-443f-b375-3ddf2f3f6f1b could not be found. Sep 30 19:35:45.037543 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:35:45.037543 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:35:45.037543 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:35:45.037543 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:35:45.037543 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:35:45.037543 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:35:45.037543 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:35:45.037543 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:35:45.037543 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:35:45.039435 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:35:45.039435 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 30 19:35:45.039435 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 30 19:35:45.039435 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 30 19:35:45.039435 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 30 19:35:45.039435 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 30 19:35:45.039435 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 30 19:35:45.039435 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7a95413-7db3-443f-b375-3ddf2f3f6f1b could not be found. Sep 30 19:35:45.039435 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:35:45.039435 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:35:45.039435 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:35:45.039435 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:35:45.039435 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:35:45.039435 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:35:45.039435 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:35:45.039435 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:35:45.039435 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7a95413-7db3-443f-b375-3ddf2f3f6f1b could not be found. Sep 30 19:35:45.039435 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:35:45.040568 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-6a559dff-843c-450d-8c5b-447c4136b6f0 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Returning 404 to user: Instance e7a95413-7db3-443f-b375-3ddf2f3f6f1b could not be found. {{(pid=120649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:35:45.040568 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-6a559dff-843c-450d-8c5b-447c4136b6f0 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/e7a95413-7db3-443f-b375-3ddf2f3f6f1b" status: 404 len: 111 microversion: 2.1 time: 0.029640 Sep 30 19:35:45.040568 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 390/744] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:45 2022] GET /compute/v2.1/servers/e7a95413-7db3-443f-b375-3ddf2f3f6f1b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 30 19:35:45.046116 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-b34ccc61-64ac-4f19-aa40-c4fca074aa24 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '.version_select at 0x7f621eeaa700>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:45.070243 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-b34ccc61-64ac-4f19-aa40-c4fca074aa24 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1678727989" status: 202 len: 0 microversion: 2.1 time: 0.027829 Sep 30 19:35:45.070827 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 355/745] 10.222.0.17 () {58 vars in 1221 bytes} [Fri Sep 30 19:35:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1678727989 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 30 19:35:45.746738 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-35cf289f-4879-49b9-8f9d-a585a2bf7ec6 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:45.747232 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-35cf289f-4879-49b9-8f9d-a585a2bf7ec6 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:45.753005 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-35cf289f-4879-49b9-8f9d-a585a2bf7ec6 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:45.753480 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-35cf289f-4879-49b9-8f9d-a585a2bf7ec6 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:45.753909 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-35cf289f-4879-49b9-8f9d-a585a2bf7ec6 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:45.754609 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-35cf289f-4879-49b9-8f9d-a585a2bf7ec6 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:45.755055 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-35cf289f-4879-49b9-8f9d-a585a2bf7ec6 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:45.755472 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-35cf289f-4879-49b9-8f9d-a585a2bf7ec6 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:45.833418 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.objects.instance [None req-35cf289f-4879-49b9-8f9d-a585a2bf7ec6 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lazy-loading 'services' on Instance uuid a84ee4e3-e6e4-4574-810f-8e5e796b4c4d {{(pid=120649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 30 19:35:45.904642 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-35cf289f-4879-49b9-8f9d-a585a2bf7ec6 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d/os-volume_attachments/2d7dd76d-f183-441b-8efa-2211585fc684" status: 202 len: 0 microversion: 2.1 time: 0.161552 Sep 30 19:35:45.905215 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 391/746] 10.222.0.17 () {58 vars in 1416 bytes} [Fri Sep 30 19:35:45 2022] DELETE /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d/os-volume_attachments/2d7dd76d-f183-441b-8efa-2211585fc684 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 30 19:35:45.915245 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-3e040413-3452-42dc-92a5-a8cdf83445dc tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:45.917930 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-3e040413-3452-42dc-92a5-a8cdf83445dc tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:45.926567 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3e040413-3452-42dc-92a5-a8cdf83445dc tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:45.927091 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3e040413-3452-42dc-92a5-a8cdf83445dc tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:45.927534 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3e040413-3452-42dc-92a5-a8cdf83445dc tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:45.928241 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3e040413-3452-42dc-92a5-a8cdf83445dc tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:45.929027 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3e040413-3452-42dc-92a5-a8cdf83445dc tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:45.929513 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3e040413-3452-42dc-92a5-a8cdf83445dc tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:45.960612 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-3e040413-3452-42dc-92a5-a8cdf83445dc tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050555 Sep 30 19:35:45.961253 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 356/747] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 30 19:35:45 2022] GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:35:46.973472 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-120dea87-e8dc-4ef7-bbbf-177eddcec31d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:46.975807 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-120dea87-e8dc-4ef7-bbbf-177eddcec31d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:46.982089 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-120dea87-e8dc-4ef7-bbbf-177eddcec31d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:46.982581 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-120dea87-e8dc-4ef7-bbbf-177eddcec31d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:46.983019 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-120dea87-e8dc-4ef7-bbbf-177eddcec31d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:46.983716 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-120dea87-e8dc-4ef7-bbbf-177eddcec31d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:46.984170 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-120dea87-e8dc-4ef7-bbbf-177eddcec31d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:46.984619 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-120dea87-e8dc-4ef7-bbbf-177eddcec31d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:47.014527 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-120dea87-e8dc-4ef7-bbbf-177eddcec31d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045815 Sep 30 19:35:47.015085 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 392/748] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 30 19:35:46 2022] GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 30 19:35:47.081024 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-d924abf3-427a-4cc0-8694-a4fb4e232418 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:47.081549 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-d924abf3-427a-4cc0-8694-a4fb4e232418 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:47.087691 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d924abf3-427a-4cc0-8694-a4fb4e232418 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:47.088167 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d924abf3-427a-4cc0-8694-a4fb4e232418 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:47.088631 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d924abf3-427a-4cc0-8694-a4fb4e232418 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:47.089309 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d924abf3-427a-4cc0-8694-a4fb4e232418 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:47.089759 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d924abf3-427a-4cc0-8694-a4fb4e232418 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:47.090181 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d924abf3-427a-4cc0-8694-a4fb4e232418 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:47.114214 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-d924abf3-427a-4cc0-8694-a4fb4e232418 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d] Going to try to terminate instance {{(pid=120648) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 30 19:35:47.189420 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-d924abf3-427a-4cc0-8694-a4fb4e232418 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d" status: 204 len: 0 microversion: 2.1 time: 0.111784 Sep 30 19:35:47.190026 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 357/749] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 30 19:35:47 2022] DELETE /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 30 19:35:47.198701 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-cf54592f-9785-4657-ba8e-11e5f4af5baf tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:47.199310 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-cf54592f-9785-4657-ba8e-11e5f4af5baf tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:47.205095 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-cf54592f-9785-4657-ba8e-11e5f4af5baf tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:47.205576 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-cf54592f-9785-4657-ba8e-11e5f4af5baf tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:47.206016 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-cf54592f-9785-4657-ba8e-11e5f4af5baf tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:47.206696 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-cf54592f-9785-4657-ba8e-11e5f4af5baf tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:47.207149 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-cf54592f-9785-4657-ba8e-11e5f4af5baf tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:47.207633 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-cf54592f-9785-4657-ba8e-11e5f4af5baf tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:47.338324 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-cf54592f-9785-4657-ba8e-11e5f4af5baf tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:47.346078 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-cf54592f-9785-4657-ba8e-11e5f4af5baf tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d" status: 200 len: 1679 microversion: 2.1 time: 0.151761 Sep 30 19:35:47.346666 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 393/750] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:47 2022] GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:48.371292 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-6d4a68f1-46d2-4084-a620-5f3b6b4df779 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:48.371982 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-6d4a68f1-46d2-4084-a620-5f3b6b4df779 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:48.378222 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6d4a68f1-46d2-4084-a620-5f3b6b4df779 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:48.378698 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6d4a68f1-46d2-4084-a620-5f3b6b4df779 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:48.379124 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6d4a68f1-46d2-4084-a620-5f3b6b4df779 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:48.379810 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6d4a68f1-46d2-4084-a620-5f3b6b4df779 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:48.380255 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6d4a68f1-46d2-4084-a620-5f3b6b4df779 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:48.380702 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6d4a68f1-46d2-4084-a620-5f3b6b4df779 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:48.510521 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-6d4a68f1-46d2-4084-a620-5f3b6b4df779 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:48.518325 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-6d4a68f1-46d2-4084-a620-5f3b6b4df779 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d" status: 200 len: 1679 microversion: 2.1 time: 0.152025 Sep 30 19:35:48.518891 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 358/751] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:48 2022] GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:49.296231 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [req-b58db55d-6454-49a5-a673-7ec613e81791 req-ab47e0db-84c8-49b7-be50-a76a91609cc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a84ee4e3-e6e4-4574-810f-8e5e796b4c4d", "name": "network-vif-deleted", "tag": "703c0c85-a09a-452a-a548-87d9d670da7d"}]} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:35:49.308347 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-b58db55d-6454-49a5-a673-7ec613e81791 req-ab47e0db-84c8-49b7-be50-a76a91609cc1 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:49.308853 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-b58db55d-6454-49a5-a673-7ec613e81791 req-ab47e0db-84c8-49b7-be50-a76a91609cc1 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:49.309285 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-b58db55d-6454-49a5-a673-7ec613e81791 req-ab47e0db-84c8-49b7-be50-a76a91609cc1 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:49.322264 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.compute.server_external_events [req-b58db55d-6454-49a5-a673-7ec613e81791 req-ab47e0db-84c8-49b7-be50-a76a91609cc1 service nova] Creating event network-vif-deleted:703c0c85-a09a-452a-a548-87d9d670da7d for instance a84ee4e3-e6e4-4574-810f-8e5e796b4c4d on hv-cinder-86001 Sep 30 19:35:49.329296 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [req-b58db55d-6454-49a5-a673-7ec613e81791 req-ab47e0db-84c8-49b7-be50-a76a91609cc1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036547 Sep 30 19:35:49.330789 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 394/752] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:35:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:35:49.542263 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-0e637a7e-ffdb-41a1-a731-47d5cb2692d1 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:49.542875 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-0e637a7e-ffdb-41a1-a731-47d5cb2692d1 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:49.549381 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0e637a7e-ffdb-41a1-a731-47d5cb2692d1 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:49.549870 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0e637a7e-ffdb-41a1-a731-47d5cb2692d1 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:49.550300 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0e637a7e-ffdb-41a1-a731-47d5cb2692d1 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:49.551192 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0e637a7e-ffdb-41a1-a731-47d5cb2692d1 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:49.551650 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0e637a7e-ffdb-41a1-a731-47d5cb2692d1 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:49.552072 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0e637a7e-ffdb-41a1-a731-47d5cb2692d1 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:49.584409 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0e637a7e-ffdb-41a1-a731-47d5cb2692d1 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:49.584976 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0e637a7e-ffdb-41a1-a731-47d5cb2692d1 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:49.586137 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0e637a7e-ffdb-41a1-a731-47d5cb2692d1 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:49.586710 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.objects.instance [None req-0e637a7e-ffdb-41a1-a731-47d5cb2692d1 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lazy-loading 'fault' on Instance uuid a84ee4e3-e6e4-4574-810f-8e5e796b4c4d {{(pid=120648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 30 19:35:49.630177 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-0e637a7e-ffdb-41a1-a731-47d5cb2692d1 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:49.637801 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-0e637a7e-ffdb-41a1-a731-47d5cb2692d1 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d" status: 200 len: 1331 microversion: 2.1 time: 0.100291 Sep 30 19:35:49.638725 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 359/753] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:49 2022] GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d => generated 1331 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:50.664463 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-1c010f7c-ab5a-4dd1-9a4b-e7bbb35b7940 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:50.665092 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-1c010f7c-ab5a-4dd1-9a4b-e7bbb35b7940 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:50.671179 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1c010f7c-ab5a-4dd1-9a4b-e7bbb35b7940 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:50.671665 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1c010f7c-ab5a-4dd1-9a4b-e7bbb35b7940 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:50.672444 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1c010f7c-ab5a-4dd1-9a4b-e7bbb35b7940 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:50.672822 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1c010f7c-ab5a-4dd1-9a4b-e7bbb35b7940 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:50.673380 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1c010f7c-ab5a-4dd1-9a4b-e7bbb35b7940 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:50.673849 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1c010f7c-ab5a-4dd1-9a4b-e7bbb35b7940 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:50.687936 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.wsgi [None req-1c010f7c-ab5a-4dd1-9a4b-e7bbb35b7940 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] HTTP exception thrown: Instance a84ee4e3-e6e4-4574-810f-8e5e796b4c4d could not be found. Sep 30 19:35:50.689568 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-1c010f7c-ab5a-4dd1-9a4b-e7bbb35b7940 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Request method failure captured: Sep 30 19:35:50.689568 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: request: GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d HTTP/1.1 Sep 30 19:35:50.689568 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Accept: application/json Sep 30 19:35:50.689568 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Accept-Encoding: identity Sep 30 19:35:50.689568 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Connection: close Sep 30 19:35:50.689568 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Content-Length: 0 Sep 30 19:35:50.689568 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Content-Type: application/json Sep 30 19:35:50.689568 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Host: 10.222.0.17 Sep 30 19:35:50.689568 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Openstack-System-Scope: None Sep 30 19:35:50.689568 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: User-Agent: python-urllib3/1.26.12 Sep 30 19:35:50.689568 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Auth-Token: gAAAAABjN0ONqtIDYC2-7JPJhRMwDTFX77ua7wCzld6d05rw2OAypY6C9ruPlCf9je7iHOPQdEHBIS7fQsYNQwwCaWegqx7UtPiHvBb_B_GTauKCWL_cl9osIiSIgmJPV0ud6nFHwFaWS29rEhsSYVXTP0g-WZEwpi_MPh4YPjuB1sskH-bvyg0 Sep 30 19:35:50.689568 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Domain-Id: None Sep 30 19:35:50.689568 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Domain-Name: None Sep 30 19:35:50.689568 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Identity-Status: Confirmed Sep 30 19:35:50.689568 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Is-Admin-Project: True Sep 30 19:35:50.689568 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Domain-Id: default Sep 30 19:35:50.689568 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Domain-Name: Default Sep 30 19:35:50.689568 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Id: 612fb8a339e4478ba78bc5ef3b343b82 Sep 30 19:35:50.689568 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Name: tempest-AttachVolumeNegativeTest-1614355089 Sep 30 19:35:50.689568 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Role: member,reader Sep 30 19:35:50.689568 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Roles: member,reader Sep 30 19:35:50.691072 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/612fb8a339e4478ba78bc5ef3b343b82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/612fb8a339e4478ba78bc5ef3b343b82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/612fb8a339e4478ba78bc5ef3b343b82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_612fb8a339e4478ba78bc5ef3b343b82"}]}] Sep 30 19:35:50.691072 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant: tempest-AttachVolumeNegativeTest-1614355089 Sep 30 19:35:50.691072 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant-Id: 612fb8a339e4478ba78bc5ef3b343b82 Sep 30 19:35:50.691072 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1614355089 Sep 30 19:35:50.691072 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User: tempest-AttachVolumeNegativeTest-1614355089-project Sep 30 19:35:50.691072 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Domain-Id: default Sep 30 19:35:50.691072 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Domain-Name: Default Sep 30 19:35:50.691072 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Id: ccbdadc310fc4bf8a6679bcb39b34ff1 Sep 30 19:35:50.691072 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Name: tempest-AttachVolumeNegativeTest-1614355089-project Sep 30 19:35:50.691072 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: method: > Sep 30 19:35:50.691072 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: exception: Instance a84ee4e3-e6e4-4574-810f-8e5e796b4c4d could not be found. Sep 30 19:35:50.691072 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: action_args: {'id': 'a84ee4e3-e6e4-4574-810f-8e5e796b4c4d'} Sep 30 19:35:50.691927 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:35:50.691927 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:35:50.691927 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 30 19:35:50.691927 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 30 19:35:50.691927 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 30 19:35:50.691927 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 30 19:35:50.691927 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 30 19:35:50.691927 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 30 19:35:50.691927 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 30 19:35:50.691927 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 30 19:35:50.691927 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a84ee4e3-e6e4-4574-810f-8e5e796b4c4d could not be found. Sep 30 19:35:50.691927 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:35:50.691927 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:35:50.691927 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:35:50.691927 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:35:50.691927 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:35:50.691927 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:35:50.691927 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:35:50.691927 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:35:50.691927 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:35:50.693378 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:35:50.693378 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 30 19:35:50.693378 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 30 19:35:50.693378 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 30 19:35:50.693378 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 30 19:35:50.693378 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 30 19:35:50.693378 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 30 19:35:50.693378 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a84ee4e3-e6e4-4574-810f-8e5e796b4c4d could not be found. Sep 30 19:35:50.693378 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:35:50.693378 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:35:50.693378 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:35:50.693378 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:35:50.693378 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:35:50.693378 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:35:50.693378 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:35:50.693378 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:35:50.693378 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a84ee4e3-e6e4-4574-810f-8e5e796b4c4d could not be found. Sep 30 19:35:50.693378 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:35:50.694659 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-1c010f7c-ab5a-4dd1-9a4b-e7bbb35b7940 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Returning 404 to user: Instance a84ee4e3-e6e4-4574-810f-8e5e796b4c4d could not be found. {{(pid=120649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:35:50.694659 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-1c010f7c-ab5a-4dd1-9a4b-e7bbb35b7940 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d" status: 404 len: 111 microversion: 2.1 time: 0.032233 Sep 30 19:35:50.694659 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 395/754] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:50 2022] GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 30 19:35:50.699696 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-487a016e-c157-4e75-be36-e5b758616b5e tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '.version_select at 0x7f621ef0fdc0>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:50.718267 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-487a016e-c157-4e75-be36-e5b758616b5e tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1319065844" status: 202 len: 0 microversion: 2.1 time: 0.022339 Sep 30 19:35:50.718807 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 360/755] 10.222.0.17 () {58 vars in 1221 bytes} [Fri Sep 30 19:35:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1319065844 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 30 19:35:51.330667 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-f5896c64-087d-4bbe-9df6-372aa6d23873 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Action: 'create', calling method: .version_select at 0x7f62226cd9d0>, body: {"keypair": {"name": "tempest-keypair-1538942225", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGHzosi5P63WDGEFEWJ1uasx9LcKAebdzxH3wbnhAFBiwBRTk/QQBsVjDBuYeNBx/93TtuqAlYVOltlb0f00Y+EKDeQUX5JY0oIG9DFIjY3HSclRaXY+OZvsDeVfHnn9A=="}} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:35:51.345618 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.quota [None req-f5896c64-087d-4bbe-9df6-372aa6d23873 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Getting quotas for project 612fb8a339e4478ba78bc5ef3b343b82. Resources: {'key_pairs'} {{(pid=120649) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 30 19:35:51.349355 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.quota [None req-f5896c64-087d-4bbe-9df6-372aa6d23873 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Getting quotas for user ccbdadc310fc4bf8a6679bcb39b34ff1 and project 612fb8a339e4478ba78bc5ef3b343b82. Resources: {'key_pairs'} {{(pid=120649) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 30 19:35:51.373743 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-f5896c64-087d-4bbe-9df6-372aa6d23873 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047065 Sep 30 19:35:51.374336 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 396/756] 10.222.0.17 () {60 vars in 1159 bytes} [Fri Sep 30 19:35:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:35:52.547792 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-86ff0cb6-d295-4f90-bed2-e1a9dee81fa9 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1565300331", "imageRef": "7714d055-7d2c-4f56-9b14-45324361e286", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0c1e5405-3945-456e-8e1d-e94d5c819889"}], "security_groups": [{"name": "tempest-securitygroup--1962217874"}], "key_name": "tempest-keypair-1538942225", "user_data": "}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:35:52.651628 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.network.neutron [None req-86ff0cb6-d295-4f90-bed2-e1a9dee81fa9 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] validate_networks() for [('0c1e5405-3945-456e-8e1d-e94d5c819889', None, None, None, None, None)] {{(pid=120648) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 30 19:35:53.052515 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-86ff0cb6-d295-4f90-bed2-e1a9dee81fa9 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Flavor limits 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 30 19:35:53.052937 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-86ff0cb6-d295-4f90-bed2-e1a9dee81fa9 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Image limits 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 30 19:35:53.053406 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-86ff0cb6-d295-4f90-bed2-e1a9dee81fa9 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Flavor pref 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 30 19:35:53.054447 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-86ff0cb6-d295-4f90-bed2-e1a9dee81fa9 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Image pref 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 30 19:35:53.054856 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-86ff0cb6-d295-4f90-bed2-e1a9dee81fa9 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 30 19:35:53.063359 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-86ff0cb6-d295-4f90-bed2-e1a9dee81fa9 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:53.063834 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-86ff0cb6-d295-4f90-bed2-e1a9dee81fa9 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:53.064264 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-86ff0cb6-d295-4f90-bed2-e1a9dee81fa9 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:53.065006 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-86ff0cb6-d295-4f90-bed2-e1a9dee81fa9 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:53.065453 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-86ff0cb6-d295-4f90-bed2-e1a9dee81fa9 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:53.065870 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-86ff0cb6-d295-4f90-bed2-e1a9dee81fa9 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:53.081859 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-86ff0cb6-d295-4f90-bed2-e1a9dee81fa9 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Getting quotas for project 612fb8a339e4478ba78bc5ef3b343b82. Resources: {'instances', 'ram', 'cores'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 30 19:35:53.085730 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-86ff0cb6-d295-4f90-bed2-e1a9dee81fa9 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Getting quotas for user ccbdadc310fc4bf8a6679bcb39b34ff1 and project 612fb8a339e4478ba78bc5ef3b343b82. Resources: {'instances', 'ram', 'cores'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 30 19:35:53.096409 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-86ff0cb6-d295-4f90-bed2-e1a9dee81fa9 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Going to run 1 instances... {{(pid=120648) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 30 19:35:53.098650 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-86ff0cb6-d295-4f90-bed2-e1a9dee81fa9 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: 0aa829ac-05b3-4eba-89ed-39195a559ea4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7714d055-7d2c-4f56-9b14-45324361e286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 30 19:35:53.146302 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-86ff0cb6-d295-4f90-bed2-e1a9dee81fa9 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.603226 Sep 30 19:35:53.146945 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 361/757] 10.222.0.17 () {60 vars in 1147 bytes} [Fri Sep 30 19:35:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 30 19:35:53.158554 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-776ca4fe-bc02-4268-989b-fe8891add383 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:53.159159 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-776ca4fe-bc02-4268-989b-fe8891add383 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: 0aa829ac-05b3-4eba-89ed-39195a559ea4] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:53.217857 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-776ca4fe-bc02-4268-989b-fe8891add383 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:53.226763 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-776ca4fe-bc02-4268-989b-fe8891add383 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/0aa829ac-05b3-4eba-89ed-39195a559ea4" status: 200 len: 1242 microversion: 2.1 time: 0.072594 Sep 30 19:35:53.227633 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 397/758] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:53 2022] GET /compute/v2.1/servers/0aa829ac-05b3-4eba-89ed-39195a559ea4 => generated 1242 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:54.250001 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-7c24c71e-39bb-4bb2-8192-491b030f84c2 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:54.250524 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-7c24c71e-39bb-4bb2-8192-491b030f84c2 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: 0aa829ac-05b3-4eba-89ed-39195a559ea4] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:54.258307 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7c24c71e-39bb-4bb2-8192-491b030f84c2 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:54.258789 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7c24c71e-39bb-4bb2-8192-491b030f84c2 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:54.259223 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7c24c71e-39bb-4bb2-8192-491b030f84c2 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:54.259909 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7c24c71e-39bb-4bb2-8192-491b030f84c2 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:54.260361 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7c24c71e-39bb-4bb2-8192-491b030f84c2 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:54.260808 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7c24c71e-39bb-4bb2-8192-491b030f84c2 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:54.320079 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-7c24c71e-39bb-4bb2-8192-491b030f84c2 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:54.327631 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-7c24c71e-39bb-4bb2-8192-491b030f84c2 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/0aa829ac-05b3-4eba-89ed-39195a559ea4" status: 200 len: 1294 microversion: 2.1 time: 0.081623 Sep 30 19:35:54.328189 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 362/759] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:54 2022] GET /compute/v2.1/servers/0aa829ac-05b3-4eba-89ed-39195a559ea4 => generated 1294 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:55.350325 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-c64c7b4a-2eab-471a-8e6d-94db0d42d765 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:55.351193 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-c64c7b4a-2eab-471a-8e6d-94db0d42d765 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: 0aa829ac-05b3-4eba-89ed-39195a559ea4] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:55.357702 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c64c7b4a-2eab-471a-8e6d-94db0d42d765 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:55.358193 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c64c7b4a-2eab-471a-8e6d-94db0d42d765 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:55.358631 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c64c7b4a-2eab-471a-8e6d-94db0d42d765 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:55.359917 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c64c7b4a-2eab-471a-8e6d-94db0d42d765 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:55.360629 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c64c7b4a-2eab-471a-8e6d-94db0d42d765 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:55.361213 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c64c7b4a-2eab-471a-8e6d-94db0d42d765 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:55.606155 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-c64c7b4a-2eab-471a-8e6d-94db0d42d765 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:55.613759 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-c64c7b4a-2eab-471a-8e6d-94db0d42d765 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/0aa829ac-05b3-4eba-89ed-39195a559ea4" status: 200 len: 1368 microversion: 2.1 time: 0.267319 Sep 30 19:35:55.614488 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 398/760] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:55 2022] GET /compute/v2.1/servers/0aa829ac-05b3-4eba-89ed-39195a559ea4 => generated 1368 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:35:56.039519 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-fea4aff3-5404-412e-8188-53b3a3f4e4b3 req-00879376-9459-497e-a7b1-96adcdcc61fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0aa829ac-05b3-4eba-89ed-39195a559ea4", "tag": "3141cbe0-074a-4113-97c5-c6f304ef2036"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:35:56.050782 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-fea4aff3-5404-412e-8188-53b3a3f4e4b3 req-00879376-9459-497e-a7b1-96adcdcc61fc service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:56.051366 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-fea4aff3-5404-412e-8188-53b3a3f4e4b3 req-00879376-9459-497e-a7b1-96adcdcc61fc service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:56.051819 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-fea4aff3-5404-412e-8188-53b3a3f4e4b3 req-00879376-9459-497e-a7b1-96adcdcc61fc service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:56.063493 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-fea4aff3-5404-412e-8188-53b3a3f4e4b3 req-00879376-9459-497e-a7b1-96adcdcc61fc service nova] Creating event network-changed:3141cbe0-074a-4113-97c5-c6f304ef2036 for instance 0aa829ac-05b3-4eba-89ed-39195a559ea4 on hv-cinder-86001 Sep 30 19:35:56.068541 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-fea4aff3-5404-412e-8188-53b3a3f4e4b3 req-00879376-9459-497e-a7b1-96adcdcc61fc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033571 Sep 30 19:35:56.069176 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 363/761] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:35:56.637224 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-a75f67f2-d9b7-412f-8157-748de59b3043 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:56.637865 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-a75f67f2-d9b7-412f-8157-748de59b3043 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: 0aa829ac-05b3-4eba-89ed-39195a559ea4] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:56.644177 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a75f67f2-d9b7-412f-8157-748de59b3043 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:56.644699 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a75f67f2-d9b7-412f-8157-748de59b3043 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:56.645138 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a75f67f2-d9b7-412f-8157-748de59b3043 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:56.645830 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a75f67f2-d9b7-412f-8157-748de59b3043 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:56.646312 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a75f67f2-d9b7-412f-8157-748de59b3043 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:56.646738 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a75f67f2-d9b7-412f-8157-748de59b3043 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:56.803474 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-a75f67f2-d9b7-412f-8157-748de59b3043 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:56.811720 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-a75f67f2-d9b7-412f-8157-748de59b3043 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/0aa829ac-05b3-4eba-89ed-39195a559ea4" status: 200 len: 1368 microversion: 2.1 time: 0.178350 Sep 30 19:35:56.812285 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 399/762] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:56 2022] GET /compute/v2.1/servers/0aa829ac-05b3-4eba-89ed-39195a559ea4 => generated 1368 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:57.836839 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-d46c116f-3255-4d8a-a138-2204bb7217d9 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:57.837527 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-d46c116f-3255-4d8a-a138-2204bb7217d9 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: 0aa829ac-05b3-4eba-89ed-39195a559ea4] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:57.843554 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d46c116f-3255-4d8a-a138-2204bb7217d9 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:57.844064 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d46c116f-3255-4d8a-a138-2204bb7217d9 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:57.844548 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d46c116f-3255-4d8a-a138-2204bb7217d9 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:57.845232 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d46c116f-3255-4d8a-a138-2204bb7217d9 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:57.845679 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d46c116f-3255-4d8a-a138-2204bb7217d9 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:57.846100 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d46c116f-3255-4d8a-a138-2204bb7217d9 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:57.974237 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-d46c116f-3255-4d8a-a138-2204bb7217d9 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:57.982570 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-d46c116f-3255-4d8a-a138-2204bb7217d9 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/0aa829ac-05b3-4eba-89ed-39195a559ea4" status: 200 len: 1368 microversion: 2.1 time: 0.151059 Sep 30 19:35:57.983133 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 364/763] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:57 2022] GET /compute/v2.1/servers/0aa829ac-05b3-4eba-89ed-39195a559ea4 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:35:59.005401 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-7d635994-9449-4c70-95cb-74cf861d230b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:35:59.006005 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-7d635994-9449-4c70-95cb-74cf861d230b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: 0aa829ac-05b3-4eba-89ed-39195a559ea4] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:35:59.009065 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=1 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:35:59.014208 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7d635994-9449-4c70-95cb-74cf861d230b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:59.014691 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7d635994-9449-4c70-95cb-74cf861d230b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:59.015127 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7d635994-9449-4c70-95cb-74cf861d230b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:59.015813 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7d635994-9449-4c70-95cb-74cf861d230b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:35:59.016261 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7d635994-9449-4c70-95cb-74cf861d230b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:35:59.016707 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7d635994-9449-4c70-95cb-74cf861d230b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:35:59.142496 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-7d635994-9449-4c70-95cb-74cf861d230b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:35:59.149929 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-7d635994-9449-4c70-95cb-74cf861d230b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/0aa829ac-05b3-4eba-89ed-39195a559ea4" status: 200 len: 1368 microversion: 2.1 time: 0.148342 Sep 30 19:35:59.150482 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 400/764] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:35:59 2022] GET /compute/v2.1/servers/0aa829ac-05b3-4eba-89ed-39195a559ea4 => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:36:00.173292 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-b229809f-ec68-4ffb-877b-aa0b775ffb15 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:36:00.173932 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-b229809f-ec68-4ffb-877b-aa0b775ffb15 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: 0aa829ac-05b3-4eba-89ed-39195a559ea4] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:36:00.180690 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b229809f-ec68-4ffb-877b-aa0b775ffb15 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:00.181175 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b229809f-ec68-4ffb-877b-aa0b775ffb15 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:00.181607 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b229809f-ec68-4ffb-877b-aa0b775ffb15 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:00.182302 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b229809f-ec68-4ffb-877b-aa0b775ffb15 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:00.182758 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b229809f-ec68-4ffb-877b-aa0b775ffb15 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:00.183175 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b229809f-ec68-4ffb-877b-aa0b775ffb15 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:00.313392 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-b229809f-ec68-4ffb-877b-aa0b775ffb15 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:00.322335 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-b229809f-ec68-4ffb-877b-aa0b775ffb15 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/0aa829ac-05b3-4eba-89ed-39195a559ea4" status: 200 len: 1368 microversion: 2.1 time: 0.153209 Sep 30 19:36:00.323104 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 365/765] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:36:00 2022] GET /compute/v2.1/servers/0aa829ac-05b3-4eba-89ed-39195a559ea4 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:36:01.345252 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-04359f13-1a1d-4493-9103-67f996c4cb48 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:36:01.345862 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-04359f13-1a1d-4493-9103-67f996c4cb48 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: 0aa829ac-05b3-4eba-89ed-39195a559ea4] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:36:01.352991 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-04359f13-1a1d-4493-9103-67f996c4cb48 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:01.353471 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-04359f13-1a1d-4493-9103-67f996c4cb48 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:01.353900 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-04359f13-1a1d-4493-9103-67f996c4cb48 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:01.354640 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-04359f13-1a1d-4493-9103-67f996c4cb48 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:01.355040 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-04359f13-1a1d-4493-9103-67f996c4cb48 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:01.355463 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-04359f13-1a1d-4493-9103-67f996c4cb48 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:01.481580 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-04359f13-1a1d-4493-9103-67f996c4cb48 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:01.484973 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:36:01.490317 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-04359f13-1a1d-4493-9103-67f996c4cb48 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/0aa829ac-05b3-4eba-89ed-39195a559ea4" status: 200 len: 1368 microversion: 2.1 time: 0.148887 Sep 30 19:36:01.490887 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 401/766] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:36:01 2022] GET /compute/v2.1/servers/0aa829ac-05b3-4eba-89ed-39195a559ea4 => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:36:01.607666 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-f08512e6-ec9f-476e-b96b-eca4bbe11ef4 req-5772735e-4d99-4445-8a8e-c7c0d73a2cb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0aa829ac-05b3-4eba-89ed-39195a559ea4", "name": "network-vif-plugged", "status": "completed", "tag": "3141cbe0-074a-4113-97c5-c6f304ef2036"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:36:01.618334 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-f08512e6-ec9f-476e-b96b-eca4bbe11ef4 req-5772735e-4d99-4445-8a8e-c7c0d73a2cb5 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:01.618823 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-f08512e6-ec9f-476e-b96b-eca4bbe11ef4 req-5772735e-4d99-4445-8a8e-c7c0d73a2cb5 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:01.619307 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-f08512e6-ec9f-476e-b96b-eca4bbe11ef4 req-5772735e-4d99-4445-8a8e-c7c0d73a2cb5 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:01.630436 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-f08512e6-ec9f-476e-b96b-eca4bbe11ef4 req-5772735e-4d99-4445-8a8e-c7c0d73a2cb5 service nova] Creating event network-vif-plugged:3141cbe0-074a-4113-97c5-c6f304ef2036 for instance 0aa829ac-05b3-4eba-89ed-39195a559ea4 on hv-cinder-86001 Sep 30 19:36:01.636120 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-f08512e6-ec9f-476e-b96b-eca4bbe11ef4 req-5772735e-4d99-4445-8a8e-c7c0d73a2cb5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032204 Sep 30 19:36:01.636813 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 366/767] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:36:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:36:02.513483 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-5cbdc2a8-a92c-40c6-90b7-30bad27e938d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:36:02.514105 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-5cbdc2a8-a92c-40c6-90b7-30bad27e938d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: 0aa829ac-05b3-4eba-89ed-39195a559ea4] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:36:02.521646 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5cbdc2a8-a92c-40c6-90b7-30bad27e938d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:02.522123 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5cbdc2a8-a92c-40c6-90b7-30bad27e938d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:02.522566 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5cbdc2a8-a92c-40c6-90b7-30bad27e938d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:02.523269 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5cbdc2a8-a92c-40c6-90b7-30bad27e938d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:02.523833 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5cbdc2a8-a92c-40c6-90b7-30bad27e938d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:02.524443 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5cbdc2a8-a92c-40c6-90b7-30bad27e938d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:02.652652 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-5cbdc2a8-a92c-40c6-90b7-30bad27e938d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:02.660465 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-5cbdc2a8-a92c-40c6-90b7-30bad27e938d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/0aa829ac-05b3-4eba-89ed-39195a559ea4" status: 200 len: 1368 microversion: 2.1 time: 0.150743 Sep 30 19:36:02.661036 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 402/768] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:36:02 2022] GET /compute/v2.1/servers/0aa829ac-05b3-4eba-89ed-39195a559ea4 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:36:03.682011 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=2 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:36:03.682682 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=6 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:36:03.687447 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-ae2df53d-2d4e-41ec-8a7f-8402df63443f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:36:03.688138 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-ae2df53d-2d4e-41ec-8a7f-8402df63443f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: 0aa829ac-05b3-4eba-89ed-39195a559ea4] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:36:03.695707 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ae2df53d-2d4e-41ec-8a7f-8402df63443f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:03.696180 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ae2df53d-2d4e-41ec-8a7f-8402df63443f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:03.696640 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ae2df53d-2d4e-41ec-8a7f-8402df63443f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:03.697320 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ae2df53d-2d4e-41ec-8a7f-8402df63443f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:03.697765 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ae2df53d-2d4e-41ec-8a7f-8402df63443f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:03.698185 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ae2df53d-2d4e-41ec-8a7f-8402df63443f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:03.829926 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-ae2df53d-2d4e-41ec-8a7f-8402df63443f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:03.837673 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-ae2df53d-2d4e-41ec-8a7f-8402df63443f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/0aa829ac-05b3-4eba-89ed-39195a559ea4" status: 200 len: 1368 microversion: 2.1 time: 0.157160 Sep 30 19:36:03.838241 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 367/769] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:36:03 2022] GET /compute/v2.1/servers/0aa829ac-05b3-4eba-89ed-39195a559ea4 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:36:04.861190 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-6cc0c449-ecf5-46a8-99a2-a1e8b5320226 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:36:04.861738 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-6cc0c449-ecf5-46a8-99a2-a1e8b5320226 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: 0aa829ac-05b3-4eba-89ed-39195a559ea4] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:36:04.863588 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell0:SELECT=6 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:36:04.870253 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6cc0c449-ecf5-46a8-99a2-a1e8b5320226 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:04.870739 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6cc0c449-ecf5-46a8-99a2-a1e8b5320226 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:04.871181 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6cc0c449-ecf5-46a8-99a2-a1e8b5320226 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:04.871866 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6cc0c449-ecf5-46a8-99a2-a1e8b5320226 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:04.872320 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6cc0c449-ecf5-46a8-99a2-a1e8b5320226 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:04.872770 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6cc0c449-ecf5-46a8-99a2-a1e8b5320226 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:05.002037 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-6cc0c449-ecf5-46a8-99a2-a1e8b5320226 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:05.010138 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-6cc0c449-ecf5-46a8-99a2-a1e8b5320226 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/0aa829ac-05b3-4eba-89ed-39195a559ea4" status: 200 len: 1557 microversion: 2.1 time: 0.152925 Sep 30 19:36:05.010708 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 403/770] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:36:04 2022] GET /compute/v2.1/servers/0aa829ac-05b3-4eba-89ed-39195a559ea4 => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:36:05.031861 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-7707ea04-9de9-4287-aacc-421b6499aef8 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:36:05.032413 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-7707ea04-9de9-4287-aacc-421b6499aef8 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: 0aa829ac-05b3-4eba-89ed-39195a559ea4] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:36:05.038958 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7707ea04-9de9-4287-aacc-421b6499aef8 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:05.039434 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7707ea04-9de9-4287-aacc-421b6499aef8 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:05.039864 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7707ea04-9de9-4287-aacc-421b6499aef8 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:05.040579 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7707ea04-9de9-4287-aacc-421b6499aef8 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:05.041030 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7707ea04-9de9-4287-aacc-421b6499aef8 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:05.041452 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7707ea04-9de9-4287-aacc-421b6499aef8 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:05.045063 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:36:05.119012 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-7707ea04-9de9-4287-aacc-421b6499aef8 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/0aa829ac-05b3-4eba-89ed-39195a559ea4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090958 Sep 30 19:36:05.119597 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 368/771] 10.222.0.17 () {58 vars in 1275 bytes} [Fri Sep 30 19:36:05 2022] GET /compute/v2.1/servers/0aa829ac-05b3-4eba-89ed-39195a559ea4/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:36:06.251376 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [req-f37e93f5-8dbb-4748-a85b-6f63083a5aa0 req-24d7952f-c76a-4d3b-9cb7-7d9bdc8d1fb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0aa829ac-05b3-4eba-89ed-39195a559ea4", "tag": "3141cbe0-074a-4113-97c5-c6f304ef2036"}]} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:36:06.261751 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-f37e93f5-8dbb-4748-a85b-6f63083a5aa0 req-24d7952f-c76a-4d3b-9cb7-7d9bdc8d1fb3 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:06.262220 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-f37e93f5-8dbb-4748-a85b-6f63083a5aa0 req-24d7952f-c76a-4d3b-9cb7-7d9bdc8d1fb3 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:06.262646 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-f37e93f5-8dbb-4748-a85b-6f63083a5aa0 req-24d7952f-c76a-4d3b-9cb7-7d9bdc8d1fb3 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:06.276026 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.compute.server_external_events [req-f37e93f5-8dbb-4748-a85b-6f63083a5aa0 req-24d7952f-c76a-4d3b-9cb7-7d9bdc8d1fb3 service nova] Creating event network-changed:3141cbe0-074a-4113-97c5-c6f304ef2036 for instance 0aa829ac-05b3-4eba-89ed-39195a559ea4 on hv-cinder-86001 Sep 30 19:36:06.280986 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [req-f37e93f5-8dbb-4748-a85b-6f63083a5aa0 req-24d7952f-c76a-4d3b-9cb7-7d9bdc8d1fb3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033105 Sep 30 19:36:06.281525 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 404/772] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:36:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:36:12.493389 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-f62a9af8-61b4-4d12-a746-99ba03eab147 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:36:12.493969 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-f62a9af8-61b4-4d12-a746-99ba03eab147 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:36:12.495592 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:36:12.501303 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f62a9af8-61b4-4d12-a746-99ba03eab147 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:12.501769 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f62a9af8-61b4-4d12-a746-99ba03eab147 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:12.502202 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f62a9af8-61b4-4d12-a746-99ba03eab147 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:12.502894 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f62a9af8-61b4-4d12-a746-99ba03eab147 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:12.503345 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f62a9af8-61b4-4d12-a746-99ba03eab147 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:12.503770 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f62a9af8-61b4-4d12-a746-99ba03eab147 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:12.540983 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-f62a9af8-61b4-4d12-a746-99ba03eab147 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df/os-volume_attachments/b4adb4db-43c0-4fc3-baa0-8d2db21c8972" status: 200 len: 194 microversion: 2.20 time: 0.052403 Sep 30 19:36:12.541573 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 369/773] 10.222.0.17 () {60 vars in 1454 bytes} [Fri Sep 30 19:36:12 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df/os-volume_attachments/b4adb4db-43c0-4fc3-baa0-8d2db21c8972 => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 30 19:36:12.616318 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-d84823c3-04ea-4ba4-8e04-267102a8ef35 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:36:12.617086 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-d84823c3-04ea-4ba4-8e04-267102a8ef35 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:36:12.623874 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d84823c3-04ea-4ba4-8e04-267102a8ef35 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:12.624352 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d84823c3-04ea-4ba4-8e04-267102a8ef35 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:12.624814 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d84823c3-04ea-4ba4-8e04-267102a8ef35 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:12.625495 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d84823c3-04ea-4ba4-8e04-267102a8ef35 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:12.625942 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d84823c3-04ea-4ba4-8e04-267102a8ef35 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:12.626361 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d84823c3-04ea-4ba4-8e04-267102a8ef35 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:12.712065 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.objects.instance [None req-d84823c3-04ea-4ba4-8e04-267102a8ef35 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lazy-loading 'services' on Instance uuid c87cf7d2-5d47-474b-b2f0-1ddc37bc97df {{(pid=120649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 30 19:36:12.787489 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-d84823c3-04ea-4ba4-8e04-267102a8ef35 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df/os-volume_attachments/b4adb4db-43c0-4fc3-baa0-8d2db21c8972" status: 202 len: 0 microversion: 2.20 time: 0.177049 Sep 30 19:36:12.788100 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 405/774] 10.222.0.17 () {60 vars in 1457 bytes} [Fri Sep 30 19:36:12 2022] DELETE /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df/os-volume_attachments/b4adb4db-43c0-4fc3-baa0-8d2db21c8972 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 30 19:36:12.796791 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-0a9a8e2d-0f85-4205-9896-0e66fc396d80 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:36:12.798956 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-0a9a8e2d-0f85-4205-9896-0e66fc396d80 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:36:12.805493 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0a9a8e2d-0f85-4205-9896-0e66fc396d80 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:12.805976 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0a9a8e2d-0f85-4205-9896-0e66fc396d80 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:12.806415 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0a9a8e2d-0f85-4205-9896-0e66fc396d80 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:12.807109 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0a9a8e2d-0f85-4205-9896-0e66fc396d80 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:12.807566 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0a9a8e2d-0f85-4205-9896-0e66fc396d80 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:12.807991 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0a9a8e2d-0f85-4205-9896-0e66fc396d80 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:12.838111 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-0a9a8e2d-0f85-4205-9896-0e66fc396d80 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045352 Sep 30 19:36:12.838652 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 370/775] 10.222.0.17 () {60 vars in 1343 bytes} [Fri Sep 30 19:36:12 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 30 19:36:13.852408 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-ed3cb852-9c4d-4b14-978f-11731482e32b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:36:13.854682 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-ed3cb852-9c4d-4b14-978f-11731482e32b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:36:13.861228 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ed3cb852-9c4d-4b14-978f-11731482e32b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:13.861756 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ed3cb852-9c4d-4b14-978f-11731482e32b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:13.862209 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ed3cb852-9c4d-4b14-978f-11731482e32b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:13.862944 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ed3cb852-9c4d-4b14-978f-11731482e32b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:13.863442 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ed3cb852-9c4d-4b14-978f-11731482e32b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:13.863887 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ed3cb852-9c4d-4b14-978f-11731482e32b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:13.893489 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-ed3cb852-9c4d-4b14-978f-11731482e32b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046954 Sep 30 19:36:13.894032 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 406/776] 10.222.0.17 () {60 vars in 1343 bytes} [Fri Sep 30 19:36:13 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 30 19:36:14.906999 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e884f052-6b75-4ed1-9869-68b5bbd6d5c9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:36:14.909154 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-e884f052-6b75-4ed1-9869-68b5bbd6d5c9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:36:14.916493 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e884f052-6b75-4ed1-9869-68b5bbd6d5c9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:14.916974 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e884f052-6b75-4ed1-9869-68b5bbd6d5c9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:14.917411 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e884f052-6b75-4ed1-9869-68b5bbd6d5c9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:14.918097 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e884f052-6b75-4ed1-9869-68b5bbd6d5c9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:14.918553 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e884f052-6b75-4ed1-9869-68b5bbd6d5c9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:14.918974 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e884f052-6b75-4ed1-9869-68b5bbd6d5c9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:14.947311 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-e884f052-6b75-4ed1-9869-68b5bbd6d5c9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044321 Sep 30 19:36:14.947850 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 371/777] 10.222.0.17 () {60 vars in 1343 bytes} [Fri Sep 30 19:36:14 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:36:15.013610 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-f3ff8728-a9b3-482e-bec1-8dcea31996ed tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:36:15.014104 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-f3ff8728-a9b3-482e-bec1-8dcea31996ed tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:36:15.020475 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f3ff8728-a9b3-482e-bec1-8dcea31996ed tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:15.020963 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f3ff8728-a9b3-482e-bec1-8dcea31996ed tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:15.021407 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f3ff8728-a9b3-482e-bec1-8dcea31996ed tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:15.022703 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f3ff8728-a9b3-482e-bec1-8dcea31996ed tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:15.023080 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f3ff8728-a9b3-482e-bec1-8dcea31996ed tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:15.023512 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f3ff8728-a9b3-482e-bec1-8dcea31996ed tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:15.048871 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-f3ff8728-a9b3-482e-bec1-8dcea31996ed tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Going to try to terminate instance {{(pid=120649) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 30 19:36:15.126884 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-f3ff8728-a9b3-482e-bec1-8dcea31996ed tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 204 len: 0 microversion: 2.20 time: 0.116652 Sep 30 19:36:15.127636 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 407/778] 10.222.0.17 () {60 vars in 1280 bytes} [Fri Sep 30 19:36:15 2022] DELETE /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 30 19:36:15.137430 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-b7f0c281-ec75-4578-8af4-936581606da7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:36:15.138064 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-b7f0c281-ec75-4578-8af4-936581606da7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:36:15.144583 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b7f0c281-ec75-4578-8af4-936581606da7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:15.145070 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b7f0c281-ec75-4578-8af4-936581606da7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:15.145509 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b7f0c281-ec75-4578-8af4-936581606da7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:15.146199 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b7f0c281-ec75-4578-8af4-936581606da7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:15.146653 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b7f0c281-ec75-4578-8af4-936581606da7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:15.147590 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b7f0c281-ec75-4578-8af4-936581606da7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:15.286645 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-b7f0c281-ec75-4578-8af4-936581606da7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:15.295247 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-b7f0c281-ec75-4578-8af4-936581606da7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:15.296702 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-b7f0c281-ec75-4578-8af4-936581606da7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:15.297852 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-b7f0c281-ec75-4578-8af4-936581606da7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1721 microversion: 2.20 time: 0.164681 Sep 30 19:36:15.298420 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 372/779] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:36:15 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:36:16.325926 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-b67ae6c8-bf1f-4f2c-b48e-c1d4730e3f63 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:36:16.326623 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-b67ae6c8-bf1f-4f2c-b48e-c1d4730e3f63 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:36:16.333220 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b67ae6c8-bf1f-4f2c-b48e-c1d4730e3f63 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:16.333701 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b67ae6c8-bf1f-4f2c-b48e-c1d4730e3f63 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:16.334133 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b67ae6c8-bf1f-4f2c-b48e-c1d4730e3f63 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:16.335469 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b67ae6c8-bf1f-4f2c-b48e-c1d4730e3f63 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:16.335915 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b67ae6c8-bf1f-4f2c-b48e-c1d4730e3f63 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:16.336336 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b67ae6c8-bf1f-4f2c-b48e-c1d4730e3f63 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:16.472546 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-b67ae6c8-bf1f-4f2c-b48e-c1d4730e3f63 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:16.481873 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-b67ae6c8-bf1f-4f2c-b48e-c1d4730e3f63 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:16.483713 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-b67ae6c8-bf1f-4f2c-b48e-c1d4730e3f63 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:16.485250 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-b67ae6c8-bf1f-4f2c-b48e-c1d4730e3f63 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1721 microversion: 2.20 time: 0.165468 Sep 30 19:36:16.485962 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 408/780] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:36:16 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:36:17.513378 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-b74dc42c-b29b-4df3-a83e-ff11f7335e40 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:36:17.514014 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-b74dc42c-b29b-4df3-a83e-ff11f7335e40 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:36:17.520910 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b74dc42c-b29b-4df3-a83e-ff11f7335e40 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:17.521481 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b74dc42c-b29b-4df3-a83e-ff11f7335e40 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:17.522311 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b74dc42c-b29b-4df3-a83e-ff11f7335e40 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:17.523079 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b74dc42c-b29b-4df3-a83e-ff11f7335e40 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:17.523539 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b74dc42c-b29b-4df3-a83e-ff11f7335e40 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:17.524014 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b74dc42c-b29b-4df3-a83e-ff11f7335e40 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:17.659289 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-b74dc42c-b29b-4df3-a83e-ff11f7335e40 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:17.668320 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-b74dc42c-b29b-4df3-a83e-ff11f7335e40 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:17.669797 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-b74dc42c-b29b-4df3-a83e-ff11f7335e40 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:17.671028 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-b74dc42c-b29b-4df3-a83e-ff11f7335e40 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1721 microversion: 2.20 time: 0.161525 Sep 30 19:36:17.671964 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 373/781] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:36:17 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:36:18.258855 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [req-d31cd4c3-c091-4852-be8f-7929006347b5 req-f8c6b53e-02f2-475e-8e2b-20d5da577e70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c87cf7d2-5d47-474b-b2f0-1ddc37bc97df", "name": "network-vif-deleted", "tag": "408315e4-bcde-4577-8c32-5d47d233c194"}]} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:36:18.272897 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-d31cd4c3-c091-4852-be8f-7929006347b5 req-f8c6b53e-02f2-475e-8e2b-20d5da577e70 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:18.273389 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-d31cd4c3-c091-4852-be8f-7929006347b5 req-f8c6b53e-02f2-475e-8e2b-20d5da577e70 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:18.273827 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-d31cd4c3-c091-4852-be8f-7929006347b5 req-f8c6b53e-02f2-475e-8e2b-20d5da577e70 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:18.286817 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.compute.server_external_events [req-d31cd4c3-c091-4852-be8f-7929006347b5 req-f8c6b53e-02f2-475e-8e2b-20d5da577e70 service nova] Creating event network-vif-deleted:408315e4-bcde-4577-8c32-5d47d233c194 for instance c87cf7d2-5d47-474b-b2f0-1ddc37bc97df on hv-cinder-86001 Sep 30 19:36:18.293947 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [req-d31cd4c3-c091-4852-be8f-7929006347b5 req-f8c6b53e-02f2-475e-8e2b-20d5da577e70 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038900 Sep 30 19:36:18.295390 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 409/782] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:36:18.697594 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-28bb5cb3-2de2-4441-81cf-146e4faf7b84 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:36:18.698303 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-28bb5cb3-2de2-4441-81cf-146e4faf7b84 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:36:18.704730 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-28bb5cb3-2de2-4441-81cf-146e4faf7b84 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:18.705210 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-28bb5cb3-2de2-4441-81cf-146e4faf7b84 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:18.705653 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-28bb5cb3-2de2-4441-81cf-146e4faf7b84 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:18.706346 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-28bb5cb3-2de2-4441-81cf-146e4faf7b84 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:18.706813 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-28bb5cb3-2de2-4441-81cf-146e4faf7b84 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:18.707225 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-28bb5cb3-2de2-4441-81cf-146e4faf7b84 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:18.738292 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-28bb5cb3-2de2-4441-81cf-146e4faf7b84 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:18.738687 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-28bb5cb3-2de2-4441-81cf-146e4faf7b84 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:18.739124 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-28bb5cb3-2de2-4441-81cf-146e4faf7b84 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:18.739569 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.objects.instance [None req-28bb5cb3-2de2-4441-81cf-146e4faf7b84 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lazy-loading 'fault' on Instance uuid c87cf7d2-5d47-474b-b2f0-1ddc37bc97df {{(pid=120648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 30 19:36:18.793083 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-28bb5cb3-2de2-4441-81cf-146e4faf7b84 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:18.802788 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-28bb5cb3-2de2-4441-81cf-146e4faf7b84 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:18.805400 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-28bb5cb3-2de2-4441-81cf-146e4faf7b84 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:18.806554 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-28bb5cb3-2de2-4441-81cf-146e4faf7b84 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 200 len: 1370 microversion: 2.20 time: 0.113458 Sep 30 19:36:18.807102 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 374/783] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:36:18 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 1370 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:36:19.831674 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-ddf7b6c1-10f7-4395-a43b-1f33454671b9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:36:19.832468 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-ddf7b6c1-10f7-4395-a43b-1f33454671b9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:36:19.839598 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ddf7b6c1-10f7-4395-a43b-1f33454671b9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:19.840088 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ddf7b6c1-10f7-4395-a43b-1f33454671b9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:19.840572 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ddf7b6c1-10f7-4395-a43b-1f33454671b9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:19.841270 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ddf7b6c1-10f7-4395-a43b-1f33454671b9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:19.841731 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ddf7b6c1-10f7-4395-a43b-1f33454671b9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:19.842162 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ddf7b6c1-10f7-4395-a43b-1f33454671b9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:19.856276 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.wsgi [None req-ddf7b6c1-10f7-4395-a43b-1f33454671b9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] HTTP exception thrown: Instance c87cf7d2-5d47-474b-b2f0-1ddc37bc97df could not be found. Sep 30 19:36:19.857918 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-ddf7b6c1-10f7-4395-a43b-1f33454671b9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Request method failure captured: Sep 30 19:36:19.857918 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: request: GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df HTTP/1.1 Sep 30 19:36:19.857918 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Accept: application/json Sep 30 19:36:19.857918 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Accept-Encoding: identity Sep 30 19:36:19.857918 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Connection: close Sep 30 19:36:19.857918 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Content-Length: 0 Sep 30 19:36:19.857918 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Content-Type: application/json Sep 30 19:36:19.857918 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Host: 10.222.0.17 Sep 30 19:36:19.857918 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Openstack-System-Scope: None Sep 30 19:36:19.857918 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: User-Agent: python-urllib3/1.26.12 Sep 30 19:36:19.857918 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Auth-Token: gAAAAABjN0ONOwIbxc91xU7l52C5Fy5ArsRt6ZX45qakD2SHqVzbm57ZiOsFY9DJEc7VM20VbNzf_nMkRzugCjpggS9pLU0vkBtv9Nb8dhUHNADVjRcXlSEqEvNvAzNcvlBQ5lqdZ11HA75fhmXNMWOsHwjHRW6QioUNPVnYNgMj-6Kfcx2lCKY Sep 30 19:36:19.857918 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Domain-Id: None Sep 30 19:36:19.857918 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Domain-Name: None Sep 30 19:36:19.857918 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Identity-Status: Confirmed Sep 30 19:36:19.857918 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Is-Admin-Project: True Sep 30 19:36:19.857918 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Openstack-Nova-Api-Version: 2.20 Sep 30 19:36:19.857918 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Domain-Id: default Sep 30 19:36:19.857918 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Domain-Name: Default Sep 30 19:36:19.857918 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Id: 395bb9b09f7948bbad5817c88aa4accc Sep 30 19:36:19.857918 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1709301466 Sep 30 19:36:19.857918 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Role: member,reader Sep 30 19:36:19.857918 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Roles: member,reader Sep 30 19:36:19.859588 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/395bb9b09f7948bbad5817c88aa4accc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/395bb9b09f7948bbad5817c88aa4accc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/395bb9b09f7948bbad5817c88aa4accc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_395bb9b09f7948bbad5817c88aa4accc"}]}] Sep 30 19:36:19.859588 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1709301466 Sep 30 19:36:19.859588 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant-Id: 395bb9b09f7948bbad5817c88aa4accc Sep 30 19:36:19.859588 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1709301466 Sep 30 19:36:19.859588 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User: tempest-AttachVolumeShelveTestJSON-1709301466-project Sep 30 19:36:19.859588 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Domain-Id: default Sep 30 19:36:19.859588 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Domain-Name: Default Sep 30 19:36:19.859588 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Id: f7aa40f3966d4c97ab6a1a764722969d Sep 30 19:36:19.859588 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1709301466-project Sep 30 19:36:19.859588 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: method: > Sep 30 19:36:19.859588 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: exception: Instance c87cf7d2-5d47-474b-b2f0-1ddc37bc97df could not be found. Sep 30 19:36:19.859588 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: action_args: {'id': 'c87cf7d2-5d47-474b-b2f0-1ddc37bc97df'} Sep 30 19:36:19.860567 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:36:19.860567 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:36:19.860567 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 30 19:36:19.860567 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 30 19:36:19.860567 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 30 19:36:19.860567 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 30 19:36:19.860567 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 30 19:36:19.860567 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 30 19:36:19.860567 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 30 19:36:19.860567 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 30 19:36:19.860567 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c87cf7d2-5d47-474b-b2f0-1ddc37bc97df could not be found. Sep 30 19:36:19.860567 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:36:19.860567 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:36:19.860567 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:36:19.860567 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:36:19.860567 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:36:19.860567 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:36:19.860567 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:36:19.860567 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:36:19.860567 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:36:19.862145 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:36:19.862145 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 30 19:36:19.862145 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 30 19:36:19.862145 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 30 19:36:19.862145 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 30 19:36:19.862145 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 30 19:36:19.862145 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 30 19:36:19.862145 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c87cf7d2-5d47-474b-b2f0-1ddc37bc97df could not be found. Sep 30 19:36:19.862145 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:36:19.862145 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:36:19.862145 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:36:19.862145 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:36:19.862145 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:36:19.862145 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:36:19.862145 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:36:19.862145 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:36:19.862145 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c87cf7d2-5d47-474b-b2f0-1ddc37bc97df could not be found. Sep 30 19:36:19.862145 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:36:19.863555 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-ddf7b6c1-10f7-4395-a43b-1f33454671b9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Returning 404 to user: Instance c87cf7d2-5d47-474b-b2f0-1ddc37bc97df could not be found. {{(pid=120649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:36:19.863555 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-ddf7b6c1-10f7-4395-a43b-1f33454671b9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 404 len: 111 microversion: 2.20 time: 0.031937 Sep 30 19:36:19.863555 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 410/784] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:36:19 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 30 19:36:19.868222 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-9070b013-fdbf-4649-81e8-42dbb20d339d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '.version_select at 0x7f621ee7c9d0>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:36:19.887106 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-9070b013-fdbf-4649-81e8-42dbb20d339d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1346387074" status: 204 len: 0 microversion: 2.20 time: 0.022645 Sep 30 19:36:19.887667 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 375/785] 10.222.0.17 () {60 vars in 1262 bytes} [Fri Sep 30 19:36:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1346387074 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 30 19:36:20.549266 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-4dd36501-807c-45b6-9673-031b2cd11304 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Action: 'create', calling method: .version_select at 0x7f62225bc280>, body: {"keypair": {"name": "tempest-keypair-457513319", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBERVorvRRifnWtZ7GN9Ufy4S66hQggtw8E3QnhywlCavQQpqr0PjhcSJa5lbDxEhfgU/Dn4MAu0n7hlQcmGvwmZJAXZO8pWxNfrzWoZgywVmWRtgcuPCI4KLssmdJR8h+Q=="}} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:36:20.564882 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.quota [None req-4dd36501-807c-45b6-9673-031b2cd11304 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Getting quotas for project 395bb9b09f7948bbad5817c88aa4accc. Resources: {'key_pairs'} {{(pid=120649) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 30 19:36:20.568761 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.quota [None req-4dd36501-807c-45b6-9673-031b2cd11304 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Getting quotas for user f7aa40f3966d4c97ab6a1a764722969d and project 395bb9b09f7948bbad5817c88aa4accc. Resources: {'key_pairs'} {{(pid=120649) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 30 19:36:20.590791 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-4dd36501-807c-45b6-9673-031b2cd11304 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.045559 Sep 30 19:36:20.591380 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 411/786] 10.222.0.17 () {62 vars in 1200 bytes} [Fri Sep 30 19:36:20 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 47 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 30 19:36:21.831578 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-0d867961-14c7-4a67-8629-b78e7495ac72 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-365813422", "imageRef": "7714d055-7d2c-4f56-9b14-45324361e286", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bccaac20-0d1c-4bfe-8b48-c5f621cada91"}], "security_groups": [{"name": "tempest-securitygroup--179368509"}], "key_name": "tempest-keypair-457513319", "user_data": "}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:36:21.942105 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.network.neutron [None req-0d867961-14c7-4a67-8629-b78e7495ac72 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] validate_networks() for [('bccaac20-0d1c-4bfe-8b48-c5f621cada91', None, None, None, None, None)] {{(pid=120648) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 30 19:36:22.312874 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-0d867961-14c7-4a67-8629-b78e7495ac72 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Flavor limits 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 30 19:36:22.313307 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-0d867961-14c7-4a67-8629-b78e7495ac72 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Image limits 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 30 19:36:22.313786 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-0d867961-14c7-4a67-8629-b78e7495ac72 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Flavor pref 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 30 19:36:22.314250 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-0d867961-14c7-4a67-8629-b78e7495ac72 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Image pref 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 30 19:36:22.314623 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-0d867961-14c7-4a67-8629-b78e7495ac72 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 30 19:36:22.323338 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0d867961-14c7-4a67-8629-b78e7495ac72 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:22.323859 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0d867961-14c7-4a67-8629-b78e7495ac72 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:22.324416 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0d867961-14c7-4a67-8629-b78e7495ac72 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:22.325122 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0d867961-14c7-4a67-8629-b78e7495ac72 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:22.325647 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0d867961-14c7-4a67-8629-b78e7495ac72 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:22.326086 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0d867961-14c7-4a67-8629-b78e7495ac72 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:22.345915 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-0d867961-14c7-4a67-8629-b78e7495ac72 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Getting quotas for project 395bb9b09f7948bbad5817c88aa4accc. Resources: {'instances', 'ram', 'cores'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 30 19:36:22.351406 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-0d867961-14c7-4a67-8629-b78e7495ac72 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Getting quotas for user f7aa40f3966d4c97ab6a1a764722969d and project 395bb9b09f7948bbad5817c88aa4accc. Resources: {'instances', 'ram', 'cores'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 30 19:36:22.362398 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-0d867961-14c7-4a67-8629-b78e7495ac72 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Going to run 1 instances... {{(pid=120648) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 30 19:36:22.364699 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-0d867961-14c7-4a67-8629-b78e7495ac72 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7714d055-7d2c-4f56-9b14-45324361e286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 30 19:36:22.412766 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-0d867961-14c7-4a67-8629-b78e7495ac72 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.585433 Sep 30 19:36:22.413418 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 376/787] 10.222.0.17 () {62 vars in 1188 bytes} [Fri Sep 30 19:36:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 30 19:36:22.426506 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-8a22d00a-97e3-4a51-bd8d-f05f67336ab9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:36:22.427134 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-8a22d00a-97e3-4a51-bd8d-f05f67336ab9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:36:22.494186 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-8a22d00a-97e3-4a51-bd8d-f05f67336ab9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:22.501450 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-8a22d00a-97e3-4a51-bd8d-f05f67336ab9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:22.502888 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-8a22d00a-97e3-4a51-bd8d-f05f67336ab9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:22.503984 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-8a22d00a-97e3-4a51-bd8d-f05f67336ab9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1280 microversion: 2.20 time: 0.082792 Sep 30 19:36:22.504553 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 412/788] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:36:22 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1280 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:36:23.529767 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-24b47b0a-9ce1-4a79-b0c2-c1a47d038e74 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:36:23.530379 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-24b47b0a-9ce1-4a79-b0c2-c1a47d038e74 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:36:23.536752 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-24b47b0a-9ce1-4a79-b0c2-c1a47d038e74 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:23.537242 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-24b47b0a-9ce1-4a79-b0c2-c1a47d038e74 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:23.537680 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-24b47b0a-9ce1-4a79-b0c2-c1a47d038e74 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:23.538371 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-24b47b0a-9ce1-4a79-b0c2-c1a47d038e74 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:23.538831 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-24b47b0a-9ce1-4a79-b0c2-c1a47d038e74 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:23.539260 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-24b47b0a-9ce1-4a79-b0c2-c1a47d038e74 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:23.602672 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-24b47b0a-9ce1-4a79-b0c2-c1a47d038e74 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:23.610919 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-24b47b0a-9ce1-4a79-b0c2-c1a47d038e74 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:23.612455 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-24b47b0a-9ce1-4a79-b0c2-c1a47d038e74 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:23.613573 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-24b47b0a-9ce1-4a79-b0c2-c1a47d038e74 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1332 microversion: 2.20 time: 0.088301 Sep 30 19:36:23.614259 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 377/789] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:36:23 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1332 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:36:24.639212 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-da5694c0-44e4-477b-bcae-7f1bd08befc2 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:36:24.640552 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-da5694c0-44e4-477b-bcae-7f1bd08befc2 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:36:24.647897 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-da5694c0-44e4-477b-bcae-7f1bd08befc2 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:24.648450 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-da5694c0-44e4-477b-bcae-7f1bd08befc2 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:24.648848 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-da5694c0-44e4-477b-bcae-7f1bd08befc2 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:24.649555 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-da5694c0-44e4-477b-bcae-7f1bd08befc2 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:24.650202 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-da5694c0-44e4-477b-bcae-7f1bd08befc2 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:24.650638 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-da5694c0-44e4-477b-bcae-7f1bd08befc2 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:24.944710 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-da5694c0-44e4-477b-bcae-7f1bd08befc2 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:24.953344 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-da5694c0-44e4-477b-bcae-7f1bd08befc2 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:24.954835 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-da5694c0-44e4-477b-bcae-7f1bd08befc2 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:24.956015 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-da5694c0-44e4-477b-bcae-7f1bd08befc2 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1405 microversion: 2.20 time: 0.320899 Sep 30 19:36:24.956687 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 413/790] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:36:24 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1405 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:36:25.478527 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-421c8632-1d43-4289-8964-8757d3cc7fc4 req-dd152cd7-745d-43e9-8bbe-e01a1bca5905 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67a09687-3d87-4069-b17c-6ed9b6e96700", "tag": "c71e45c4-5abc-49db-8f88-3b7e95572f59"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:36:25.488758 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-421c8632-1d43-4289-8964-8757d3cc7fc4 req-dd152cd7-745d-43e9-8bbe-e01a1bca5905 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:25.489237 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-421c8632-1d43-4289-8964-8757d3cc7fc4 req-dd152cd7-745d-43e9-8bbe-e01a1bca5905 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:25.489672 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-421c8632-1d43-4289-8964-8757d3cc7fc4 req-dd152cd7-745d-43e9-8bbe-e01a1bca5905 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:25.501824 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-421c8632-1d43-4289-8964-8757d3cc7fc4 req-dd152cd7-745d-43e9-8bbe-e01a1bca5905 service nova] Creating event network-changed:c71e45c4-5abc-49db-8f88-3b7e95572f59 for instance 67a09687-3d87-4069-b17c-6ed9b6e96700 on hv-cinder-86001 Sep 30 19:36:25.507542 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-421c8632-1d43-4289-8964-8757d3cc7fc4 req-dd152cd7-745d-43e9-8bbe-e01a1bca5905 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032907 Sep 30 19:36:25.508150 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 378/791] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:36:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 30 19:36:25.982158 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-13974360-c64a-4e14-9b08-6e84fae8bbca tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:36:25.982678 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-13974360-c64a-4e14-9b08-6e84fae8bbca tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:36:25.989311 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-13974360-c64a-4e14-9b08-6e84fae8bbca tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:25.989791 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-13974360-c64a-4e14-9b08-6e84fae8bbca tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:25.990264 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-13974360-c64a-4e14-9b08-6e84fae8bbca tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:25.990978 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-13974360-c64a-4e14-9b08-6e84fae8bbca tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:25.991453 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-13974360-c64a-4e14-9b08-6e84fae8bbca tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:25.991876 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-13974360-c64a-4e14-9b08-6e84fae8bbca tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:26.118423 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-13974360-c64a-4e14-9b08-6e84fae8bbca tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:26.126305 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-13974360-c64a-4e14-9b08-6e84fae8bbca tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:26.127758 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-13974360-c64a-4e14-9b08-6e84fae8bbca tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:26.128893 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-13974360-c64a-4e14-9b08-6e84fae8bbca tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1405 microversion: 2.20 time: 0.150909 Sep 30 19:36:26.129451 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 414/792] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:36:25 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1405 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:36:27.154376 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-a09af551-fa08-4a70-a7ce-fc85e34e79f7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:36:27.155060 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-a09af551-fa08-4a70-a7ce-fc85e34e79f7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:36:27.161390 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a09af551-fa08-4a70-a7ce-fc85e34e79f7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:27.161857 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a09af551-fa08-4a70-a7ce-fc85e34e79f7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:27.162783 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a09af551-fa08-4a70-a7ce-fc85e34e79f7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:27.163456 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a09af551-fa08-4a70-a7ce-fc85e34e79f7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:27.163899 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a09af551-fa08-4a70-a7ce-fc85e34e79f7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:27.164316 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a09af551-fa08-4a70-a7ce-fc85e34e79f7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:27.297961 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-a09af551-fa08-4a70-a7ce-fc85e34e79f7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:27.306535 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-a09af551-fa08-4a70-a7ce-fc85e34e79f7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:27.307963 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-a09af551-fa08-4a70-a7ce-fc85e34e79f7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:27.309089 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-a09af551-fa08-4a70-a7ce-fc85e34e79f7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1405 microversion: 2.20 time: 0.159435 Sep 30 19:36:27.309641 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 379/793] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:36:27 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:36:28.333433 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-dfc56492-ccc1-4443-a154-c86f6f1263eb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:36:28.334543 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-dfc56492-ccc1-4443-a154-c86f6f1263eb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:36:28.342075 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-dfc56492-ccc1-4443-a154-c86f6f1263eb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:28.342613 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-dfc56492-ccc1-4443-a154-c86f6f1263eb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:28.343027 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-dfc56492-ccc1-4443-a154-c86f6f1263eb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:28.343730 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-dfc56492-ccc1-4443-a154-c86f6f1263eb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:28.344212 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-dfc56492-ccc1-4443-a154-c86f6f1263eb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:28.344703 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-dfc56492-ccc1-4443-a154-c86f6f1263eb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:28.475265 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-dfc56492-ccc1-4443-a154-c86f6f1263eb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:28.483148 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-dfc56492-ccc1-4443-a154-c86f6f1263eb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:28.484643 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-dfc56492-ccc1-4443-a154-c86f6f1263eb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:28.485770 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-dfc56492-ccc1-4443-a154-c86f6f1263eb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1405 microversion: 2.20 time: 0.156193 Sep 30 19:36:28.486323 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 415/794] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:36:28 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:36:29.511053 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-ede1b76d-ee6b-48cf-82ac-6b772d3c166e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:36:29.511682 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-ede1b76d-ee6b-48cf-82ac-6b772d3c166e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:36:29.518084 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ede1b76d-ee6b-48cf-82ac-6b772d3c166e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:29.518565 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ede1b76d-ee6b-48cf-82ac-6b772d3c166e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:29.518998 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ede1b76d-ee6b-48cf-82ac-6b772d3c166e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:29.519681 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ede1b76d-ee6b-48cf-82ac-6b772d3c166e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:29.520129 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ede1b76d-ee6b-48cf-82ac-6b772d3c166e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:29.520586 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ede1b76d-ee6b-48cf-82ac-6b772d3c166e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:29.650423 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-ede1b76d-ee6b-48cf-82ac-6b772d3c166e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:29.658453 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-ede1b76d-ee6b-48cf-82ac-6b772d3c166e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:29.660172 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-ede1b76d-ee6b-48cf-82ac-6b772d3c166e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:29.661303 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-ede1b76d-ee6b-48cf-82ac-6b772d3c166e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1405 microversion: 2.20 time: 0.154194 Sep 30 19:36:29.661856 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 380/795] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:36:29 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:36:30.687396 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-63772a7c-7eb4-4f97-b823-bce553c965e3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:36:30.688005 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-63772a7c-7eb4-4f97-b823-bce553c965e3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:36:30.690433 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:36:30.696265 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-63772a7c-7eb4-4f97-b823-bce553c965e3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:30.696782 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-63772a7c-7eb4-4f97-b823-bce553c965e3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:30.697221 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-63772a7c-7eb4-4f97-b823-bce553c965e3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:30.697913 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-63772a7c-7eb4-4f97-b823-bce553c965e3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:30.698375 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-63772a7c-7eb4-4f97-b823-bce553c965e3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:30.698806 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-63772a7c-7eb4-4f97-b823-bce553c965e3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:30.824807 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-63772a7c-7eb4-4f97-b823-bce553c965e3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:30.832940 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-63772a7c-7eb4-4f97-b823-bce553c965e3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:30.834973 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-63772a7c-7eb4-4f97-b823-bce553c965e3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:30.836067 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-63772a7c-7eb4-4f97-b823-bce553c965e3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1405 microversion: 2.20 time: 0.152577 Sep 30 19:36:30.836654 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 416/796] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:36:30 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:36:31.792145 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-34fbb248-b04d-40f0-ad4b-c482a2d97254 req-35973cde-950f-48d8-867d-87c2aa820696 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67a09687-3d87-4069-b17c-6ed9b6e96700", "name": "network-vif-plugged", "status": "completed", "tag": "c71e45c4-5abc-49db-8f88-3b7e95572f59"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:36:31.805165 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-34fbb248-b04d-40f0-ad4b-c482a2d97254 req-35973cde-950f-48d8-867d-87c2aa820696 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:31.805825 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-34fbb248-b04d-40f0-ad4b-c482a2d97254 req-35973cde-950f-48d8-867d-87c2aa820696 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:31.806257 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-34fbb248-b04d-40f0-ad4b-c482a2d97254 req-35973cde-950f-48d8-867d-87c2aa820696 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:31.817266 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-34fbb248-b04d-40f0-ad4b-c482a2d97254 req-35973cde-950f-48d8-867d-87c2aa820696 service nova] Creating event network-vif-plugged:c71e45c4-5abc-49db-8f88-3b7e95572f59 for instance 67a09687-3d87-4069-b17c-6ed9b6e96700 on hv-cinder-86001 Sep 30 19:36:31.822158 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-34fbb248-b04d-40f0-ad4b-c482a2d97254 req-35973cde-950f-48d8-867d-87c2aa820696 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033624 Sep 30 19:36:31.822740 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 381/797] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:36:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:36:31.859932 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-df599f17-47f0-4c35-9588-adff8fc92d26 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:36:31.860690 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-df599f17-47f0-4c35-9588-adff8fc92d26 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:36:31.868609 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-df599f17-47f0-4c35-9588-adff8fc92d26 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:31.869137 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-df599f17-47f0-4c35-9588-adff8fc92d26 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:31.869579 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-df599f17-47f0-4c35-9588-adff8fc92d26 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:31.870478 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-df599f17-47f0-4c35-9588-adff8fc92d26 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:31.870936 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-df599f17-47f0-4c35-9588-adff8fc92d26 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:31.871390 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-df599f17-47f0-4c35-9588-adff8fc92d26 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:32.001697 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-df599f17-47f0-4c35-9588-adff8fc92d26 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:32.010407 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-df599f17-47f0-4c35-9588-adff8fc92d26 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:32.011860 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-df599f17-47f0-4c35-9588-adff8fc92d26 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:32.013117 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-df599f17-47f0-4c35-9588-adff8fc92d26 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1405 microversion: 2.20 time: 0.157001 Sep 30 19:36:32.013684 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 417/798] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:36:31 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:36:33.039128 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-f2d2d435-313d-41d9-b0fc-e7a42a2a1bbb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:36:33.039748 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-f2d2d435-313d-41d9-b0fc-e7a42a2a1bbb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:36:33.041728 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=2 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:36:33.042409 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=6 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:36:33.049300 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f2d2d435-313d-41d9-b0fc-e7a42a2a1bbb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:33.049783 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f2d2d435-313d-41d9-b0fc-e7a42a2a1bbb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:33.050215 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f2d2d435-313d-41d9-b0fc-e7a42a2a1bbb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:33.050907 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f2d2d435-313d-41d9-b0fc-e7a42a2a1bbb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:33.051358 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f2d2d435-313d-41d9-b0fc-e7a42a2a1bbb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:33.051787 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f2d2d435-313d-41d9-b0fc-e7a42a2a1bbb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:33.179987 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f2d2d435-313d-41d9-b0fc-e7a42a2a1bbb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:33.188033 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f2d2d435-313d-41d9-b0fc-e7a42a2a1bbb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:33.189556 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f2d2d435-313d-41d9-b0fc-e7a42a2a1bbb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:33.190655 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-f2d2d435-313d-41d9-b0fc-e7a42a2a1bbb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1405 microversion: 2.20 time: 0.156661 Sep 30 19:36:33.191896 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 382/799] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:36:33 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:36:33.287075 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-ab675a59-956c-4c3a-aab9-7124f7f4c21d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:36:33.287578 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-ab675a59-956c-4c3a-aab9-7124f7f4c21d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:36:33.289521 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell0:SELECT=6 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:36:33.295303 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ab675a59-956c-4c3a-aab9-7124f7f4c21d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:33.295795 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ab675a59-956c-4c3a-aab9-7124f7f4c21d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:33.296235 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ab675a59-956c-4c3a-aab9-7124f7f4c21d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:33.296973 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ab675a59-956c-4c3a-aab9-7124f7f4c21d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:33.297439 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ab675a59-956c-4c3a-aab9-7124f7f4c21d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:33.297874 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ab675a59-956c-4c3a-aab9-7124f7f4c21d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:33.301753 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell1:SELECT=84,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:36:33.387562 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.objects.instance [None req-ab675a59-956c-4c3a-aab9-7124f7f4c21d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lazy-loading 'services' on Instance uuid 99020333-8572-4b29-bfa8-d5961bcde715 {{(pid=120649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 30 19:36:33.458912 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-ab675a59-956c-4c3a-aab9-7124f7f4c21d tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "DELETE /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715/os-volume_attachments/e29cd59a-1410-41be-ad01-d23ec3d14174" status: 202 len: 0 microversion: 2.1 time: 0.176652 Sep 30 19:36:33.459507 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 418/800] 10.222.0.17 () {58 vars in 1416 bytes} [Fri Sep 30 19:36:33 2022] DELETE /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715/os-volume_attachments/e29cd59a-1410-41be-ad01-d23ec3d14174 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 30 19:36:33.467931 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-6ace0da0-e2d9-46dd-9f79-6c0ba00f7c88 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:36:33.470117 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-6ace0da0-e2d9-46dd-9f79-6c0ba00f7c88 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:36:33.475972 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6ace0da0-e2d9-46dd-9f79-6c0ba00f7c88 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:33.476499 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6ace0da0-e2d9-46dd-9f79-6c0ba00f7c88 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:33.476948 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6ace0da0-e2d9-46dd-9f79-6c0ba00f7c88 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:33.477639 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6ace0da0-e2d9-46dd-9f79-6c0ba00f7c88 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:33.478099 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6ace0da0-e2d9-46dd-9f79-6c0ba00f7c88 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:33.478531 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6ace0da0-e2d9-46dd-9f79-6c0ba00f7c88 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:33.509249 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-6ace0da0-e2d9-46dd-9f79-6c0ba00f7c88 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045284 Sep 30 19:36:33.509810 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 383/801] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 30 19:36:33 2022] GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:36:34.216947 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-f8a1d04f-6998-45eb-abb5-0d0faab561b9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:36:34.217647 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-f8a1d04f-6998-45eb-abb5-0d0faab561b9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:36:34.223845 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f8a1d04f-6998-45eb-abb5-0d0faab561b9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:34.224330 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f8a1d04f-6998-45eb-abb5-0d0faab561b9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:34.224807 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f8a1d04f-6998-45eb-abb5-0d0faab561b9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:34.225503 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f8a1d04f-6998-45eb-abb5-0d0faab561b9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:34.225958 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f8a1d04f-6998-45eb-abb5-0d0faab561b9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:34.226415 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f8a1d04f-6998-45eb-abb5-0d0faab561b9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:34.373431 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-f8a1d04f-6998-45eb-abb5-0d0faab561b9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:34.381768 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-f8a1d04f-6998-45eb-abb5-0d0faab561b9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:34.383241 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-f8a1d04f-6998-45eb-abb5-0d0faab561b9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:34.384347 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-f8a1d04f-6998-45eb-abb5-0d0faab561b9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1405 microversion: 2.20 time: 0.171777 Sep 30 19:36:34.384923 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 419/802] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:36:34 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1405 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:36:34.522299 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-5342f2bc-7a52-4a27-bf65-a1e2cf648965 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:36:34.524343 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-5342f2bc-7a52-4a27-bf65-a1e2cf648965 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:36:34.530661 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5342f2bc-7a52-4a27-bf65-a1e2cf648965 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:34.531136 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5342f2bc-7a52-4a27-bf65-a1e2cf648965 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:34.531569 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5342f2bc-7a52-4a27-bf65-a1e2cf648965 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:34.532258 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5342f2bc-7a52-4a27-bf65-a1e2cf648965 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:34.532735 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5342f2bc-7a52-4a27-bf65-a1e2cf648965 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:34.533159 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5342f2bc-7a52-4a27-bf65-a1e2cf648965 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:34.564135 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-5342f2bc-7a52-4a27-bf65-a1e2cf648965 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046303 Sep 30 19:36:34.564726 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 384/803] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 30 19:36:34 2022] GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:36:35.409804 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-cdf75f3f-65ee-4890-9478-fe5c5a0c224e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:36:35.410421 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-cdf75f3f-65ee-4890-9478-fe5c5a0c224e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:36:35.417370 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-cdf75f3f-65ee-4890-9478-fe5c5a0c224e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:35.417862 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-cdf75f3f-65ee-4890-9478-fe5c5a0c224e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:35.418304 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-cdf75f3f-65ee-4890-9478-fe5c5a0c224e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:35.419003 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-cdf75f3f-65ee-4890-9478-fe5c5a0c224e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:35.419464 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-cdf75f3f-65ee-4890-9478-fe5c5a0c224e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:35.419896 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-cdf75f3f-65ee-4890-9478-fe5c5a0c224e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:35.548917 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-cdf75f3f-65ee-4890-9478-fe5c5a0c224e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:35.557460 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-cdf75f3f-65ee-4890-9478-fe5c5a0c224e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:35.558896 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-cdf75f3f-65ee-4890-9478-fe5c5a0c224e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:35.560056 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-cdf75f3f-65ee-4890-9478-fe5c5a0c224e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1596 microversion: 2.20 time: 0.154445 Sep 30 19:36:35.560650 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 420/804] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:36:35 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1596 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:36:35.576854 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-155c5cdc-ef66-4549-b55d-5b69fee0aa4a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:36:35.579050 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-155c5cdc-ef66-4549-b55d-5b69fee0aa4a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:36:35.583774 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-8fdb0611-2bc3-4613-997d-ca4e51d76b74 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:36:35.584268 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-8fdb0611-2bc3-4613-997d-ca4e51d76b74 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:36:35.585448 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-155c5cdc-ef66-4549-b55d-5b69fee0aa4a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:35.585936 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-155c5cdc-ef66-4549-b55d-5b69fee0aa4a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:35.586370 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-155c5cdc-ef66-4549-b55d-5b69fee0aa4a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:35.587058 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-155c5cdc-ef66-4549-b55d-5b69fee0aa4a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:35.587512 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-155c5cdc-ef66-4549-b55d-5b69fee0aa4a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:35.587935 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-155c5cdc-ef66-4549-b55d-5b69fee0aa4a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:35.590014 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8fdb0611-2bc3-4613-997d-ca4e51d76b74 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:35.590495 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8fdb0611-2bc3-4613-997d-ca4e51d76b74 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:35.590928 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8fdb0611-2bc3-4613-997d-ca4e51d76b74 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:35.591548 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=83 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:36:35.591652 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8fdb0611-2bc3-4613-997d-ca4e51d76b74 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:35.592054 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8fdb0611-2bc3-4613-997d-ca4e51d76b74 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:35.592508 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8fdb0611-2bc3-4613-997d-ca4e51d76b74 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:35.617933 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-155c5cdc-ef66-4549-b55d-5b69fee0aa4a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044864 Sep 30 19:36:35.618494 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 385/805] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 30 19:36:35 2022] GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 30 19:36:35.670708 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-8fdb0611-2bc3-4613-997d-ca4e51d76b74 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.090602 Sep 30 19:36:35.671298 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 421/806] 10.222.0.17 () {60 vars in 1316 bytes} [Fri Sep 30 19:36:35 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 30 19:36:35.700701 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-f5f0cedf-2b08-4c73-9a92-25781f87cc70 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:36:35.701202 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-f5f0cedf-2b08-4c73-9a92-25781f87cc70 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:36:35.706998 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f5f0cedf-2b08-4c73-9a92-25781f87cc70 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:35.707480 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f5f0cedf-2b08-4c73-9a92-25781f87cc70 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:35.707920 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f5f0cedf-2b08-4c73-9a92-25781f87cc70 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:35.708635 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f5f0cedf-2b08-4c73-9a92-25781f87cc70 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:35.709633 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f5f0cedf-2b08-4c73-9a92-25781f87cc70 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:35.710085 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f5f0cedf-2b08-4c73-9a92-25781f87cc70 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:35.735424 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-f5f0cedf-2b08-4c73-9a92-25781f87cc70 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Going to try to terminate instance {{(pid=120648) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 30 19:36:35.809751 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-f5f0cedf-2b08-4c73-9a92-25781f87cc70 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "DELETE /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715" status: 204 len: 0 microversion: 2.1 time: 0.112590 Sep 30 19:36:35.812552 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 386/807] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 30 19:36:35 2022] DELETE /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 30 19:36:35.819756 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-5ceb5a9d-0ede-4953-ae92-cae55503bbb0 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:36:35.820439 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-5ceb5a9d-0ede-4953-ae92-cae55503bbb0 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:36:35.826384 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5ceb5a9d-0ede-4953-ae92-cae55503bbb0 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:35.826892 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5ceb5a9d-0ede-4953-ae92-cae55503bbb0 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:35.827327 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5ceb5a9d-0ede-4953-ae92-cae55503bbb0 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:35.828045 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5ceb5a9d-0ede-4953-ae92-cae55503bbb0 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:35.828792 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5ceb5a9d-0ede-4953-ae92-cae55503bbb0 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:35.829242 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5ceb5a9d-0ede-4953-ae92-cae55503bbb0 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:36.088821 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-5ceb5a9d-0ede-4953-ae92-cae55503bbb0 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:36.096454 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-5ceb5a9d-0ede-4953-ae92-cae55503bbb0 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715" status: 200 len: 1689 microversion: 2.1 time: 0.281818 Sep 30 19:36:36.097227 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 422/808] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:36:35 2022] GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715 => generated 1689 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:36:36.665940 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-72c9fff8-2e39-48b9-9789-7290e18de943 req-c2353672-1feb-4a19-b53d-a111caa999f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67a09687-3d87-4069-b17c-6ed9b6e96700", "tag": "c71e45c4-5abc-49db-8f88-3b7e95572f59"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:36:36.675674 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-72c9fff8-2e39-48b9-9789-7290e18de943 req-c2353672-1feb-4a19-b53d-a111caa999f2 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:36.676292 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-72c9fff8-2e39-48b9-9789-7290e18de943 req-c2353672-1feb-4a19-b53d-a111caa999f2 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:36.676811 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-72c9fff8-2e39-48b9-9789-7290e18de943 req-c2353672-1feb-4a19-b53d-a111caa999f2 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:36.688134 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-72c9fff8-2e39-48b9-9789-7290e18de943 req-c2353672-1feb-4a19-b53d-a111caa999f2 service nova] Creating event network-changed:c71e45c4-5abc-49db-8f88-3b7e95572f59 for instance 67a09687-3d87-4069-b17c-6ed9b6e96700 on hv-cinder-86001 Sep 30 19:36:36.693033 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-72c9fff8-2e39-48b9-9789-7290e18de943 req-c2353672-1feb-4a19-b53d-a111caa999f2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031163 Sep 30 19:36:36.694272 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 387/809] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:36:37.118883 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-3a66d23a-7abb-4b4f-aac3-86c9b9f1aebd tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:36:37.119623 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-3a66d23a-7abb-4b4f-aac3-86c9b9f1aebd tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:36:37.126572 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3a66d23a-7abb-4b4f-aac3-86c9b9f1aebd tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:37.127022 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3a66d23a-7abb-4b4f-aac3-86c9b9f1aebd tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:37.127461 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3a66d23a-7abb-4b4f-aac3-86c9b9f1aebd tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:37.128163 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3a66d23a-7abb-4b4f-aac3-86c9b9f1aebd tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:37.128637 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3a66d23a-7abb-4b4f-aac3-86c9b9f1aebd tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:37.129089 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3a66d23a-7abb-4b4f-aac3-86c9b9f1aebd tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:37.258238 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-3a66d23a-7abb-4b4f-aac3-86c9b9f1aebd tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:37.265945 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-3a66d23a-7abb-4b4f-aac3-86c9b9f1aebd tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715" status: 200 len: 1689 microversion: 2.1 time: 0.151491 Sep 30 19:36:37.266514 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 423/810] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:36:37 2022] GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715 => generated 1689 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:36:38.291850 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-14515764-fdff-45df-8f71-729b4fb58052 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:36:38.292568 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-14515764-fdff-45df-8f71-729b4fb58052 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:36:38.298587 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-14515764-fdff-45df-8f71-729b4fb58052 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:38.299061 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-14515764-fdff-45df-8f71-729b4fb58052 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:38.299486 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-14515764-fdff-45df-8f71-729b4fb58052 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:38.300162 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-14515764-fdff-45df-8f71-729b4fb58052 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:38.300685 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-14515764-fdff-45df-8f71-729b4fb58052 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:38.301121 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-14515764-fdff-45df-8f71-729b4fb58052 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:38.433839 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-14515764-fdff-45df-8f71-729b4fb58052 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:38.441464 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-14515764-fdff-45df-8f71-729b4fb58052 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715" status: 200 len: 1689 microversion: 2.1 time: 0.154978 Sep 30 19:36:38.442019 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 388/811] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:36:38 2022] GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715 => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:36:39.464045 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-d34f08f1-9079-49de-a8d7-5c7fefd9b84f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:36:39.464695 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-d34f08f1-9079-49de-a8d7-5c7fefd9b84f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:36:39.471345 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d34f08f1-9079-49de-a8d7-5c7fefd9b84f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:39.471886 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d34f08f1-9079-49de-a8d7-5c7fefd9b84f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:39.472332 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d34f08f1-9079-49de-a8d7-5c7fefd9b84f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:39.473052 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d34f08f1-9079-49de-a8d7-5c7fefd9b84f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:39.473517 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d34f08f1-9079-49de-a8d7-5c7fefd9b84f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:39.473948 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d34f08f1-9079-49de-a8d7-5c7fefd9b84f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:39.688230 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-d34f08f1-9079-49de-a8d7-5c7fefd9b84f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:39.696744 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-d34f08f1-9079-49de-a8d7-5c7fefd9b84f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715" status: 200 len: 1689 microversion: 2.1 time: 0.236623 Sep 30 19:36:39.697308 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 424/812] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:36:39 2022] GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715 => generated 1689 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:36:40.720046 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-58ee7493-0a17-4bba-9af1-057e349c5102 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:36:40.720683 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-58ee7493-0a17-4bba-9af1-057e349c5102 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:36:40.727022 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-58ee7493-0a17-4bba-9af1-057e349c5102 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:40.727507 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-58ee7493-0a17-4bba-9af1-057e349c5102 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:40.727940 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-58ee7493-0a17-4bba-9af1-057e349c5102 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:40.728662 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-58ee7493-0a17-4bba-9af1-057e349c5102 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:40.729117 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-58ee7493-0a17-4bba-9af1-057e349c5102 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:40.729547 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-58ee7493-0a17-4bba-9af1-057e349c5102 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:40.836255 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-58ee7493-0a17-4bba-9af1-057e349c5102 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:40.850118 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [req-f37b9b87-fe22-4bc2-a175-b42bf6386e9a req-170a9136-6e2f-4209-992e-a24795c35b3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99020333-8572-4b29-bfa8-d5961bcde715", "name": "network-vif-deleted", "tag": "21fca32a-5249-4344-9c8b-48685af3e0a7"}]} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:36:40.851777 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-58ee7493-0a17-4bba-9af1-057e349c5102 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715" status: 200 len: 1622 microversion: 2.1 time: 0.135497 Sep 30 19:36:40.852359 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 389/813] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:36:40 2022] GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715 => generated 1622 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:36:40.864516 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-f37b9b87-fe22-4bc2-a175-b42bf6386e9a req-170a9136-6e2f-4209-992e-a24795c35b3f service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:40.864516 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-f37b9b87-fe22-4bc2-a175-b42bf6386e9a req-170a9136-6e2f-4209-992e-a24795c35b3f service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:40.864516 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-f37b9b87-fe22-4bc2-a175-b42bf6386e9a req-170a9136-6e2f-4209-992e-a24795c35b3f service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:40.879635 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.compute.server_external_events [req-f37b9b87-fe22-4bc2-a175-b42bf6386e9a req-170a9136-6e2f-4209-992e-a24795c35b3f service nova] Creating event network-vif-deleted:21fca32a-5249-4344-9c8b-48685af3e0a7 for instance 99020333-8572-4b29-bfa8-d5961bcde715 on hv-cinder-86001 Sep 30 19:36:40.887399 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [req-f37b9b87-fe22-4bc2-a175-b42bf6386e9a req-170a9136-6e2f-4209-992e-a24795c35b3f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040991 Sep 30 19:36:40.888419 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 425/814] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:36:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:36:41.876969 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-7012ff8a-ef6d-49b7-b9ae-d0e48640815c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:36:41.877561 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-7012ff8a-ef6d-49b7-b9ae-d0e48640815c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 99020333-8572-4b29-bfa8-d5961bcde715] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:36:41.884298 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7012ff8a-ef6d-49b7-b9ae-d0e48640815c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:41.884796 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7012ff8a-ef6d-49b7-b9ae-d0e48640815c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:41.885291 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7012ff8a-ef6d-49b7-b9ae-d0e48640815c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:41.885998 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7012ff8a-ef6d-49b7-b9ae-d0e48640815c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:41.886452 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7012ff8a-ef6d-49b7-b9ae-d0e48640815c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:41.886878 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7012ff8a-ef6d-49b7-b9ae-d0e48640815c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:41.900911 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.wsgi [None req-7012ff8a-ef6d-49b7-b9ae-d0e48640815c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] HTTP exception thrown: Instance 99020333-8572-4b29-bfa8-d5961bcde715 could not be found. Sep 30 19:36:41.902566 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-7012ff8a-ef6d-49b7-b9ae-d0e48640815c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Request method failure captured: Sep 30 19:36:41.902566 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: request: GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715 HTTP/1.1 Sep 30 19:36:41.902566 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 30 19:36:41.902566 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 30 19:36:41.902566 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Connection: close Sep 30 19:36:41.902566 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Length: 0 Sep 30 19:36:41.902566 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 30 19:36:41.902566 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Host: 10.222.0.17 Sep 30 19:36:41.902566 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 30 19:36:41.902566 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 30 19:36:41.902566 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjN0OLY5VUOI52bt3J_Dc8WpYWhiT0R61qetUr3OqzHkN-xal7RFSGHLx8a-oxcImL0Kgnf7Pk8IY6K4zB9sLscM3atT-JC4PMbFzZy3-3CihN1VE_98RxWRix6-oQ90T5ltyX81-Z_CCz7FqHItP5YzDUiDTxr5fpifGluWDXW2hKMss Sep 30 19:36:41.902566 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 30 19:36:41.902566 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 30 19:36:41.902566 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 30 19:36:41.902566 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 30 19:36:41.902566 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 30 19:36:41.902566 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 30 19:36:41.902566 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Id: de44d50bb79d48189cd74cad8079e01f Sep 30 19:36:41.902566 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1953016591 Sep 30 19:36:41.902566 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 30 19:36:41.902566 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 30 19:36:41.904075 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/de44d50bb79d48189cd74cad8079e01f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/de44d50bb79d48189cd74cad8079e01f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/de44d50bb79d48189cd74cad8079e01f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_de44d50bb79d48189cd74cad8079e01f"}]}] Sep 30 19:36:41.904075 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1953016591 Sep 30 19:36:41.904075 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Id: de44d50bb79d48189cd74cad8079e01f Sep 30 19:36:41.904075 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1953016591 Sep 30 19:36:41.904075 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User: tempest-ServerRescueNegativeTestJSON-1953016591-project Sep 30 19:36:41.904075 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 30 19:36:41.904075 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 30 19:36:41.904075 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Id: 624738daa9db4aff885d71ea2d65fb26 Sep 30 19:36:41.904075 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1953016591-project Sep 30 19:36:41.904075 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: method: > Sep 30 19:36:41.904075 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: exception: Instance 99020333-8572-4b29-bfa8-d5961bcde715 could not be found. Sep 30 19:36:41.904075 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: action_args: {'id': '99020333-8572-4b29-bfa8-d5961bcde715'} Sep 30 19:36:41.905127 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:36:41.905127 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:36:41.905127 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 30 19:36:41.905127 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 30 19:36:41.905127 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 30 19:36:41.905127 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 30 19:36:41.905127 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 30 19:36:41.905127 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 30 19:36:41.905127 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 30 19:36:41.905127 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 30 19:36:41.905127 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99020333-8572-4b29-bfa8-d5961bcde715 could not be found. Sep 30 19:36:41.905127 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:36:41.905127 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:36:41.905127 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:36:41.905127 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:36:41.905127 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:36:41.905127 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:36:41.905127 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:36:41.905127 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:36:41.905127 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:36:41.906497 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:36:41.906497 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 30 19:36:41.906497 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 30 19:36:41.906497 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 30 19:36:41.906497 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 30 19:36:41.906497 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 30 19:36:41.906497 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 30 19:36:41.906497 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99020333-8572-4b29-bfa8-d5961bcde715 could not be found. Sep 30 19:36:41.906497 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:36:41.906497 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:36:41.906497 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:36:41.906497 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:36:41.906497 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:36:41.906497 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:36:41.906497 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:36:41.906497 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:36:41.906497 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99020333-8572-4b29-bfa8-d5961bcde715 could not be found. Sep 30 19:36:41.906497 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:36:41.907705 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-7012ff8a-ef6d-49b7-b9ae-d0e48640815c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Returning 404 to user: Instance 99020333-8572-4b29-bfa8-d5961bcde715 could not be found. {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:36:41.907705 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-7012ff8a-ef6d-49b7-b9ae-d0e48640815c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715" status: 404 len: 111 microversion: 2.1 time: 0.030966 Sep 30 19:36:41.907705 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 390/815] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:36:41 2022] GET /compute/v2.1/servers/99020333-8572-4b29-bfa8-d5961bcde715 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 30 19:36:41.915027 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-6b51b965-e332-4bc8-b97a-73a52fe990a7 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '.version_select at 0x7f6222619d30>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:36:41.936137 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-6b51b965-e332-4bc8-b97a-73a52fe990a7 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2027476012" status: 202 len: 0 microversion: 2.1 time: 0.026547 Sep 30 19:36:41.936752 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 426/816] 10.222.0.17 () {58 vars in 1221 bytes} [Fri Sep 30 19:36:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2027476012 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 30 19:36:44.797759 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-8c0676ac-d95c-4850-a7ce-32c02b365b0a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:36:44.798271 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-8c0676ac-d95c-4850-a7ce-32c02b365b0a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:36:44.800929 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=65,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:36:44.806289 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8c0676ac-d95c-4850-a7ce-32c02b365b0a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:44.806770 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8c0676ac-d95c-4850-a7ce-32c02b365b0a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:44.807203 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8c0676ac-d95c-4850-a7ce-32c02b365b0a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:44.807889 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8c0676ac-d95c-4850-a7ce-32c02b365b0a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:44.808343 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8c0676ac-d95c-4850-a7ce-32c02b365b0a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:44.808794 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8c0676ac-d95c-4850-a7ce-32c02b365b0a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:44.835880 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-8c0676ac-d95c-4850-a7ce-32c02b365b0a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Going to try to terminate instance {{(pid=120648) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 30 19:36:44.913146 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-8c0676ac-d95c-4850-a7ce-32c02b365b0a tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "DELETE /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 204 len: 0 microversion: 2.1 time: 0.118163 Sep 30 19:36:44.913921 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 391/817] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 30 19:36:44 2022] DELETE /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 30 19:36:44.921683 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-c6c8bf8e-2974-49bf-a485-184220167206 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:36:44.922407 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-c6c8bf8e-2974-49bf-a485-184220167206 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:36:44.930159 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c6c8bf8e-2974-49bf-a485-184220167206 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:44.930642 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c6c8bf8e-2974-49bf-a485-184220167206 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:44.931082 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c6c8bf8e-2974-49bf-a485-184220167206 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:44.931772 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c6c8bf8e-2974-49bf-a485-184220167206 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:44.932223 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c6c8bf8e-2974-49bf-a485-184220167206 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:44.932668 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c6c8bf8e-2974-49bf-a485-184220167206 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:45.062272 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-c6c8bf8e-2974-49bf-a485-184220167206 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:45.070494 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-c6c8bf8e-2974-49bf-a485-184220167206 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1509 microversion: 2.1 time: 0.152617 Sep 30 19:36:45.071090 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 427/818] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:36:44 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:36:46.095263 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-34af5f50-31cd-41f1-98a2-66ecddf6ba4c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:36:46.095960 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-34af5f50-31cd-41f1-98a2-66ecddf6ba4c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:36:46.102830 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-34af5f50-31cd-41f1-98a2-66ecddf6ba4c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:46.103313 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-34af5f50-31cd-41f1-98a2-66ecddf6ba4c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:46.103748 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-34af5f50-31cd-41f1-98a2-66ecddf6ba4c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:46.104465 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-34af5f50-31cd-41f1-98a2-66ecddf6ba4c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:46.104920 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-34af5f50-31cd-41f1-98a2-66ecddf6ba4c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:46.105350 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-34af5f50-31cd-41f1-98a2-66ecddf6ba4c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:46.324151 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-34af5f50-31cd-41f1-98a2-66ecddf6ba4c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:46.332129 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-34af5f50-31cd-41f1-98a2-66ecddf6ba4c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1509 microversion: 2.1 time: 0.241070 Sep 30 19:36:46.332869 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 392/819] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:36:46 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1509 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:36:46.645911 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [req-0a200d03-8f53-46ea-b4ff-bbdffacb3f05 req-525e469a-1c90-40ce-9c48-b71dda06aecc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31", "name": "network-vif-deleted", "tag": "55d19521-9bc7-4a83-a9b2-6c9a8c1ae53f"}]} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:36:46.657087 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-0a200d03-8f53-46ea-b4ff-bbdffacb3f05 req-525e469a-1c90-40ce-9c48-b71dda06aecc service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:46.657472 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-0a200d03-8f53-46ea-b4ff-bbdffacb3f05 req-525e469a-1c90-40ce-9c48-b71dda06aecc service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:46.657898 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-0a200d03-8f53-46ea-b4ff-bbdffacb3f05 req-525e469a-1c90-40ce-9c48-b71dda06aecc service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:46.672414 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.compute.server_external_events [req-0a200d03-8f53-46ea-b4ff-bbdffacb3f05 req-525e469a-1c90-40ce-9c48-b71dda06aecc service nova] Creating event network-vif-deleted:55d19521-9bc7-4a83-a9b2-6c9a8c1ae53f for instance 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 on hv-cinder-86001 Sep 30 19:36:46.677932 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [req-0a200d03-8f53-46ea-b4ff-bbdffacb3f05 req-525e469a-1c90-40ce-9c48-b71dda06aecc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035560 Sep 30 19:36:46.678773 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 428/820] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:36:47.355549 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-ab07ac59-ab85-44bb-a0d8-fb33bce466bc tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:36:47.356188 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-ab07ac59-ab85-44bb-a0d8-fb33bce466bc tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:36:47.363275 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ab07ac59-ab85-44bb-a0d8-fb33bce466bc tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:47.363792 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ab07ac59-ab85-44bb-a0d8-fb33bce466bc tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:47.364227 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ab07ac59-ab85-44bb-a0d8-fb33bce466bc tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:47.365024 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ab07ac59-ab85-44bb-a0d8-fb33bce466bc tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:47.366140 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ab07ac59-ab85-44bb-a0d8-fb33bce466bc tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:47.366624 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ab07ac59-ab85-44bb-a0d8-fb33bce466bc tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:47.401230 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ab07ac59-ab85-44bb-a0d8-fb33bce466bc tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:47.401888 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ab07ac59-ab85-44bb-a0d8-fb33bce466bc tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:47.402420 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ab07ac59-ab85-44bb-a0d8-fb33bce466bc tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:47.402881 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.objects.instance [None req-ab07ac59-ab85-44bb-a0d8-fb33bce466bc tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lazy-loading 'fault' on Instance uuid 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 {{(pid=120648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 30 19:36:47.446164 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-ab07ac59-ab85-44bb-a0d8-fb33bce466bc tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:47.453871 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-ab07ac59-ab85-44bb-a0d8-fb33bce466bc tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 200 len: 1312 microversion: 2.1 time: 0.102190 Sep 30 19:36:47.454764 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 393/821] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:36:47 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 1312 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:36:48.478875 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-1ed7bd66-1a69-4712-9f10-aab467e46459 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:36:48.479578 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-1ed7bd66-1a69-4712-9f10-aab467e46459 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:36:48.485696 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1ed7bd66-1a69-4712-9f10-aab467e46459 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:48.486185 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1ed7bd66-1a69-4712-9f10-aab467e46459 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:48.486626 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1ed7bd66-1a69-4712-9f10-aab467e46459 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:48.487324 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1ed7bd66-1a69-4712-9f10-aab467e46459 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:48.487783 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1ed7bd66-1a69-4712-9f10-aab467e46459 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:48.488214 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1ed7bd66-1a69-4712-9f10-aab467e46459 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:48.501096 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.wsgi [None req-1ed7bd66-1a69-4712-9f10-aab467e46459 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] HTTP exception thrown: Instance 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 could not be found. Sep 30 19:36:48.502680 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-1ed7bd66-1a69-4712-9f10-aab467e46459 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Request method failure captured: Sep 30 19:36:48.502680 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: request: GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 HTTP/1.1 Sep 30 19:36:48.502680 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Accept: application/json Sep 30 19:36:48.502680 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Accept-Encoding: identity Sep 30 19:36:48.502680 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Connection: close Sep 30 19:36:48.502680 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Content-Length: 0 Sep 30 19:36:48.502680 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Content-Type: application/json Sep 30 19:36:48.502680 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Host: 10.222.0.17 Sep 30 19:36:48.502680 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Openstack-System-Scope: None Sep 30 19:36:48.502680 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: User-Agent: python-urllib3/1.26.12 Sep 30 19:36:48.502680 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Auth-Token: gAAAAABjN0OLY5VUOI52bt3J_Dc8WpYWhiT0R61qetUr3OqzHkN-xal7RFSGHLx8a-oxcImL0Kgnf7Pk8IY6K4zB9sLscM3atT-JC4PMbFzZy3-3CihN1VE_98RxWRix6-oQ90T5ltyX81-Z_CCz7FqHItP5YzDUiDTxr5fpifGluWDXW2hKMss Sep 30 19:36:48.502680 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Domain-Id: None Sep 30 19:36:48.502680 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Domain-Name: None Sep 30 19:36:48.502680 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Identity-Status: Confirmed Sep 30 19:36:48.502680 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Is-Admin-Project: True Sep 30 19:36:48.502680 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Domain-Id: default Sep 30 19:36:48.502680 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Domain-Name: Default Sep 30 19:36:48.502680 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Id: de44d50bb79d48189cd74cad8079e01f Sep 30 19:36:48.502680 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1953016591 Sep 30 19:36:48.502680 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Role: member,reader Sep 30 19:36:48.502680 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Roles: member,reader Sep 30 19:36:48.504260 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/de44d50bb79d48189cd74cad8079e01f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/de44d50bb79d48189cd74cad8079e01f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/de44d50bb79d48189cd74cad8079e01f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_de44d50bb79d48189cd74cad8079e01f"}]}] Sep 30 19:36:48.504260 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1953016591 Sep 30 19:36:48.504260 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant-Id: de44d50bb79d48189cd74cad8079e01f Sep 30 19:36:48.504260 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1953016591 Sep 30 19:36:48.504260 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User: tempest-ServerRescueNegativeTestJSON-1953016591-project Sep 30 19:36:48.504260 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Domain-Id: default Sep 30 19:36:48.504260 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Domain-Name: Default Sep 30 19:36:48.504260 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Id: 624738daa9db4aff885d71ea2d65fb26 Sep 30 19:36:48.504260 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1953016591-project Sep 30 19:36:48.504260 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: method: > Sep 30 19:36:48.504260 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: exception: Instance 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 could not be found. Sep 30 19:36:48.504260 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: action_args: {'id': '45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31'} Sep 30 19:36:48.505185 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:36:48.505185 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:36:48.505185 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 30 19:36:48.505185 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 30 19:36:48.505185 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 30 19:36:48.505185 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 30 19:36:48.505185 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 30 19:36:48.505185 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 30 19:36:48.505185 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 30 19:36:48.505185 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 30 19:36:48.505185 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 could not be found. Sep 30 19:36:48.505185 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:36:48.505185 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:36:48.505185 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:36:48.505185 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:36:48.505185 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:36:48.505185 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:36:48.505185 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:36:48.505185 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:36:48.505185 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:36:48.506659 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:36:48.506659 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 30 19:36:48.506659 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 30 19:36:48.506659 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 30 19:36:48.506659 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 30 19:36:48.506659 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 30 19:36:48.506659 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 30 19:36:48.506659 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 could not be found. Sep 30 19:36:48.506659 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:36:48.506659 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:36:48.506659 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:36:48.506659 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:36:48.506659 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:36:48.506659 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:36:48.506659 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:36:48.506659 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:36:48.506659 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 could not be found. Sep 30 19:36:48.506659 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:36:48.508001 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-1ed7bd66-1a69-4712-9f10-aab467e46459 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Returning 404 to user: Instance 45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 could not be found. {{(pid=120649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:36:48.508001 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-1ed7bd66-1a69-4712-9f10-aab467e46459 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31" status: 404 len: 111 microversion: 2.1 time: 0.030506 Sep 30 19:36:48.508001 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 429/822] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:36:48 2022] GET /compute/v2.1/servers/45d9d8a3-7220-4cbb-b0a0-e4703cbbbe31 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 30 19:36:48.512720 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-1d0a026c-eb4b-42be-bd9a-cb39f1d6c67c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:36:48.513333 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-1d0a026c-eb4b-42be-bd9a-cb39f1d6c67c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 5fd6c296-8008-4f27-82c0-36839a4eec3f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:36:48.520041 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1d0a026c-eb4b-42be-bd9a-cb39f1d6c67c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:48.520560 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1d0a026c-eb4b-42be-bd9a-cb39f1d6c67c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:48.520995 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1d0a026c-eb4b-42be-bd9a-cb39f1d6c67c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:48.522218 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1d0a026c-eb4b-42be-bd9a-cb39f1d6c67c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:48.522688 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1d0a026c-eb4b-42be-bd9a-cb39f1d6c67c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:48.523152 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1d0a026c-eb4b-42be-bd9a-cb39f1d6c67c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:48.548821 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-1d0a026c-eb4b-42be-bd9a-cb39f1d6c67c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 5fd6c296-8008-4f27-82c0-36839a4eec3f] Going to try to terminate instance {{(pid=120648) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 30 19:36:48.622189 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-1d0a026c-eb4b-42be-bd9a-cb39f1d6c67c tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f" status: 204 len: 0 microversion: 2.1 time: 0.112751 Sep 30 19:36:48.628404 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 394/823] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 30 19:36:48 2022] DELETE /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 30 19:36:48.637312 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-432c97e0-1924-4934-aa4c-630dc6c5a994 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:36:48.637952 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-432c97e0-1924-4934-aa4c-630dc6c5a994 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 5fd6c296-8008-4f27-82c0-36839a4eec3f] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:36:48.644083 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-432c97e0-1924-4934-aa4c-630dc6c5a994 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:48.644607 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-432c97e0-1924-4934-aa4c-630dc6c5a994 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:48.645046 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-432c97e0-1924-4934-aa4c-630dc6c5a994 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:48.645726 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-432c97e0-1924-4934-aa4c-630dc6c5a994 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:48.646177 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-432c97e0-1924-4934-aa4c-630dc6c5a994 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:48.646642 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-432c97e0-1924-4934-aa4c-630dc6c5a994 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:48.776642 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-432c97e0-1924-4934-aa4c-630dc6c5a994 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:48.784178 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-432c97e0-1924-4934-aa4c-630dc6c5a994 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f" status: 200 len: 1522 microversion: 2.1 time: 0.150712 Sep 30 19:36:48.785032 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 430/824] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:36:48 2022] GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:36:49.807744 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-fd064a3e-872a-451d-b465-6680546eaef4 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:36:49.808476 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-fd064a3e-872a-451d-b465-6680546eaef4 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 5fd6c296-8008-4f27-82c0-36839a4eec3f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:36:49.814786 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fd064a3e-872a-451d-b465-6680546eaef4 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:49.815267 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fd064a3e-872a-451d-b465-6680546eaef4 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:49.815705 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fd064a3e-872a-451d-b465-6680546eaef4 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:49.816405 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fd064a3e-872a-451d-b465-6680546eaef4 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:49.816864 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fd064a3e-872a-451d-b465-6680546eaef4 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:49.817288 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fd064a3e-872a-451d-b465-6680546eaef4 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:49.942578 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-fd064a3e-872a-451d-b465-6680546eaef4 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:49.950826 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-fd064a3e-872a-451d-b465-6680546eaef4 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f" status: 200 len: 1522 microversion: 2.1 time: 0.147257 Sep 30 19:36:49.951331 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 395/825] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:36:49 2022] GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:36:50.973354 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-2f5619f6-5f0d-4ff1-865c-a837263ca72f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:36:50.973955 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-2f5619f6-5f0d-4ff1-865c-a837263ca72f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 5fd6c296-8008-4f27-82c0-36839a4eec3f] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:36:50.981091 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2f5619f6-5f0d-4ff1-865c-a837263ca72f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:50.981577 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2f5619f6-5f0d-4ff1-865c-a837263ca72f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:50.982024 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2f5619f6-5f0d-4ff1-865c-a837263ca72f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:50.982704 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2f5619f6-5f0d-4ff1-865c-a837263ca72f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:50.983157 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2f5619f6-5f0d-4ff1-865c-a837263ca72f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:50.983583 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2f5619f6-5f0d-4ff1-865c-a837263ca72f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:51.108988 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-2f5619f6-5f0d-4ff1-865c-a837263ca72f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:51.116486 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-2f5619f6-5f0d-4ff1-865c-a837263ca72f tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f" status: 200 len: 1522 microversion: 2.1 time: 0.147028 Sep 30 19:36:51.117042 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 431/826] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:36:50 2022] GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:36:51.901367 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-d759c50f-55be-4170-b7f9-00af00d74795 req-0208de75-4c05-4f5d-9b55-bdc16cdfbaee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fd6c296-8008-4f27-82c0-36839a4eec3f", "name": "network-vif-deleted", "tag": "6ac4279f-c732-4cbf-8ee8-224018cd79f8"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:36:51.912046 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-d759c50f-55be-4170-b7f9-00af00d74795 req-0208de75-4c05-4f5d-9b55-bdc16cdfbaee service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:51.912572 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-d759c50f-55be-4170-b7f9-00af00d74795 req-0208de75-4c05-4f5d-9b55-bdc16cdfbaee service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:51.912996 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-d759c50f-55be-4170-b7f9-00af00d74795 req-0208de75-4c05-4f5d-9b55-bdc16cdfbaee service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:51.923525 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-d759c50f-55be-4170-b7f9-00af00d74795 req-0208de75-4c05-4f5d-9b55-bdc16cdfbaee service nova] Creating event network-vif-deleted:6ac4279f-c732-4cbf-8ee8-224018cd79f8 for instance 5fd6c296-8008-4f27-82c0-36839a4eec3f on hv-cinder-86001 Sep 30 19:36:51.928789 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-d759c50f-55be-4170-b7f9-00af00d74795 req-0208de75-4c05-4f5d-9b55-bdc16cdfbaee service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031220 Sep 30 19:36:51.929261 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 396/827] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:36:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:36:52.139078 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-c8b4f38d-7530-4561-adcd-92415b373595 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:36:52.139696 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-c8b4f38d-7530-4561-adcd-92415b373595 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 5fd6c296-8008-4f27-82c0-36839a4eec3f] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:36:52.146190 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c8b4f38d-7530-4561-adcd-92415b373595 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:52.147326 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c8b4f38d-7530-4561-adcd-92415b373595 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:52.147764 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c8b4f38d-7530-4561-adcd-92415b373595 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:52.148528 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c8b4f38d-7530-4561-adcd-92415b373595 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:52.148992 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c8b4f38d-7530-4561-adcd-92415b373595 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:52.149421 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c8b4f38d-7530-4561-adcd-92415b373595 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:52.183742 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c8b4f38d-7530-4561-adcd-92415b373595 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:52.184152 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c8b4f38d-7530-4561-adcd-92415b373595 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:52.184614 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c8b4f38d-7530-4561-adcd-92415b373595 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:52.185683 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.objects.instance [None req-c8b4f38d-7530-4561-adcd-92415b373595 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lazy-loading 'fault' on Instance uuid 5fd6c296-8008-4f27-82c0-36839a4eec3f {{(pid=120649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 30 19:36:52.230111 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-c8b4f38d-7530-4561-adcd-92415b373595 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624738daa9db4aff885d71ea2d65fb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de44d50bb79d48189cd74cad8079e01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:36:52.238274 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-c8b4f38d-7530-4561-adcd-92415b373595 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f" status: 200 len: 1311 microversion: 2.1 time: 0.103194 Sep 30 19:36:52.238857 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 432/828] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:36:52 2022] GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f => generated 1311 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:36:53.262837 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-0718aba6-adc9-45ce-9171-685966aa5bf3 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:36:53.263550 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-0718aba6-adc9-45ce-9171-685966aa5bf3 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] [instance: 5fd6c296-8008-4f27-82c0-36839a4eec3f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:36:53.269590 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0718aba6-adc9-45ce-9171-685966aa5bf3 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:53.270066 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0718aba6-adc9-45ce-9171-685966aa5bf3 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:53.270501 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0718aba6-adc9-45ce-9171-685966aa5bf3 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:53.271180 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0718aba6-adc9-45ce-9171-685966aa5bf3 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:36:53.272118 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0718aba6-adc9-45ce-9171-685966aa5bf3 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:36:53.272565 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0718aba6-adc9-45ce-9171-685966aa5bf3 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:36:53.285587 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.wsgi [None req-0718aba6-adc9-45ce-9171-685966aa5bf3 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] HTTP exception thrown: Instance 5fd6c296-8008-4f27-82c0-36839a4eec3f could not be found. Sep 30 19:36:53.287806 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-0718aba6-adc9-45ce-9171-685966aa5bf3 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Request method failure captured: Sep 30 19:36:53.287806 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: request: GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f HTTP/1.1 Sep 30 19:36:53.287806 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 30 19:36:53.287806 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 30 19:36:53.287806 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Connection: close Sep 30 19:36:53.287806 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Length: 0 Sep 30 19:36:53.287806 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 30 19:36:53.287806 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Host: 10.222.0.17 Sep 30 19:36:53.287806 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 30 19:36:53.287806 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 30 19:36:53.287806 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjN0OLY5VUOI52bt3J_Dc8WpYWhiT0R61qetUr3OqzHkN-xal7RFSGHLx8a-oxcImL0Kgnf7Pk8IY6K4zB9sLscM3atT-JC4PMbFzZy3-3CihN1VE_98RxWRix6-oQ90T5ltyX81-Z_CCz7FqHItP5YzDUiDTxr5fpifGluWDXW2hKMss Sep 30 19:36:53.287806 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 30 19:36:53.287806 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 30 19:36:53.287806 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 30 19:36:53.287806 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 30 19:36:53.287806 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 30 19:36:53.287806 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 30 19:36:53.287806 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Id: de44d50bb79d48189cd74cad8079e01f Sep 30 19:36:53.287806 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1953016591 Sep 30 19:36:53.287806 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 30 19:36:53.287806 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 30 19:36:53.289403 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/de44d50bb79d48189cd74cad8079e01f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/de44d50bb79d48189cd74cad8079e01f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/de44d50bb79d48189cd74cad8079e01f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_de44d50bb79d48189cd74cad8079e01f"}]}] Sep 30 19:36:53.289403 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1953016591 Sep 30 19:36:53.289403 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Id: de44d50bb79d48189cd74cad8079e01f Sep 30 19:36:53.289403 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1953016591 Sep 30 19:36:53.289403 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User: tempest-ServerRescueNegativeTestJSON-1953016591-project Sep 30 19:36:53.289403 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 30 19:36:53.289403 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 30 19:36:53.289403 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Id: 624738daa9db4aff885d71ea2d65fb26 Sep 30 19:36:53.289403 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1953016591-project Sep 30 19:36:53.289403 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: method: > Sep 30 19:36:53.289403 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: exception: Instance 5fd6c296-8008-4f27-82c0-36839a4eec3f could not be found. Sep 30 19:36:53.289403 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: action_args: {'id': '5fd6c296-8008-4f27-82c0-36839a4eec3f'} Sep 30 19:36:53.290415 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:36:53.290415 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:36:53.290415 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 30 19:36:53.290415 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 30 19:36:53.290415 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 30 19:36:53.290415 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 30 19:36:53.290415 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 30 19:36:53.290415 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 30 19:36:53.290415 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 30 19:36:53.290415 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 30 19:36:53.290415 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fd6c296-8008-4f27-82c0-36839a4eec3f could not be found. Sep 30 19:36:53.290415 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:36:53.290415 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:36:53.290415 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:36:53.290415 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:36:53.290415 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:36:53.290415 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:36:53.290415 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:36:53.290415 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:36:53.290415 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:36:53.291893 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:36:53.291893 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 30 19:36:53.291893 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 30 19:36:53.291893 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 30 19:36:53.291893 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 30 19:36:53.291893 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 30 19:36:53.291893 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 30 19:36:53.291893 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fd6c296-8008-4f27-82c0-36839a4eec3f could not be found. Sep 30 19:36:53.291893 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:36:53.291893 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:36:53.291893 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:36:53.291893 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:36:53.291893 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:36:53.291893 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:36:53.291893 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:36:53.291893 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:36:53.291893 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fd6c296-8008-4f27-82c0-36839a4eec3f could not be found. Sep 30 19:36:53.291893 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:36:53.293481 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-0718aba6-adc9-45ce-9171-685966aa5bf3 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] Returning 404 to user: Instance 5fd6c296-8008-4f27-82c0-36839a4eec3f could not be found. {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:36:53.293481 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-0718aba6-adc9-45ce-9171-685966aa5bf3 tempest-ServerRescueNegativeTestJSON-1953016591 tempest-ServerRescueNegativeTestJSON-1953016591-project] 10.222.0.17 "GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f" status: 404 len: 111 microversion: 2.1 time: 0.031085 Sep 30 19:36:53.293481 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 397/829] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:36:53 2022] GET /compute/v2.1/servers/5fd6c296-8008-4f27-82c0-36839a4eec3f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 30 19:37:01.040766 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-1efab2bc-3ef9-4b6b-9054-a80db60fbe10 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:37:01.043029 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-1efab2bc-3ef9-4b6b-9054-a80db60fbe10 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:37:01.045173 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:37:01.050364 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1efab2bc-3ef9-4b6b-9054-a80db60fbe10 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:01.050851 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1efab2bc-3ef9-4b6b-9054-a80db60fbe10 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:01.051291 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1efab2bc-3ef9-4b6b-9054-a80db60fbe10 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:01.051989 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1efab2bc-3ef9-4b6b-9054-a80db60fbe10 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:01.052489 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1efab2bc-3ef9-4b6b-9054-a80db60fbe10 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:01.053459 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1efab2bc-3ef9-4b6b-9054-a80db60fbe10 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:01.083966 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-1efab2bc-3ef9-4b6b-9054-a80db60fbe10 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047907 Sep 30 19:37:01.084641 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 433/830] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 30 19:37:01 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 30 19:37:01.149572 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-924231c7-83cd-49d8-84e5-1291bdd82966 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:37:01.150151 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-924231c7-83cd-49d8-84e5-1291bdd82966 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:37:01.157504 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-924231c7-83cd-49d8-84e5-1291bdd82966 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:01.157994 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-924231c7-83cd-49d8-84e5-1291bdd82966 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:01.158429 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-924231c7-83cd-49d8-84e5-1291bdd82966 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:01.159134 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-924231c7-83cd-49d8-84e5-1291bdd82966 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:01.159845 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-924231c7-83cd-49d8-84e5-1291bdd82966 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:01.160271 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-924231c7-83cd-49d8-84e5-1291bdd82966 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:01.189193 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-924231c7-83cd-49d8-84e5-1291bdd82966 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Going to try to terminate instance {{(pid=120648) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 30 19:37:01.203115 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:37:01.267346 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-924231c7-83cd-49d8-84e5-1291bdd82966 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "DELETE /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 204 len: 0 microversion: 2.1 time: 0.121673 Sep 30 19:37:01.268140 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 398/831] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 30 19:37:01 2022] DELETE /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 30 19:37:01.277932 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-16d97168-d4dc-480a-af88-5351ca412e1d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:37:01.278554 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-16d97168-d4dc-480a-af88-5351ca412e1d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:37:01.284894 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-16d97168-d4dc-480a-af88-5351ca412e1d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:01.285575 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-16d97168-d4dc-480a-af88-5351ca412e1d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:01.286017 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-16d97168-d4dc-480a-af88-5351ca412e1d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:01.286718 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-16d97168-d4dc-480a-af88-5351ca412e1d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:01.287731 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-16d97168-d4dc-480a-af88-5351ca412e1d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:01.288159 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-16d97168-d4dc-480a-af88-5351ca412e1d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:01.422227 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-16d97168-d4dc-480a-af88-5351ca412e1d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:37:01.430016 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-16d97168-d4dc-480a-af88-5351ca412e1d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1673 microversion: 2.1 time: 0.156682 Sep 30 19:37:01.430582 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 434/832] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:37:01 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:37:02.453489 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-83b28faf-5176-49e1-b775-f2c6d97e1e02 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:37:02.454183 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-83b28faf-5176-49e1-b775-f2c6d97e1e02 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:37:02.460232 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-83b28faf-5176-49e1-b775-f2c6d97e1e02 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:02.460733 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-83b28faf-5176-49e1-b775-f2c6d97e1e02 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:02.461158 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-83b28faf-5176-49e1-b775-f2c6d97e1e02 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:02.461839 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-83b28faf-5176-49e1-b775-f2c6d97e1e02 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:02.462289 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-83b28faf-5176-49e1-b775-f2c6d97e1e02 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:02.462710 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-83b28faf-5176-49e1-b775-f2c6d97e1e02 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:02.599991 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-83b28faf-5176-49e1-b775-f2c6d97e1e02 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:37:02.607777 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-83b28faf-5176-49e1-b775-f2c6d97e1e02 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1673 microversion: 2.1 time: 0.158376 Sep 30 19:37:02.608331 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 399/833] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:37:02 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:37:03.569950 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [req-d8414ea6-e647-4b55-86eb-0d69323e3fba req-64605307-36f2-4522-bf6e-ba40e52cd168 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "304c3216-3e08-4ea0-9ca4-ab7d78a952a9", "name": "network-vif-deleted", "tag": "f09c6fe2-495b-40c6-ab14-1c805dd88322"}]} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:37:03.581154 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-d8414ea6-e647-4b55-86eb-0d69323e3fba req-64605307-36f2-4522-bf6e-ba40e52cd168 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:03.581805 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-d8414ea6-e647-4b55-86eb-0d69323e3fba req-64605307-36f2-4522-bf6e-ba40e52cd168 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:03.582413 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-d8414ea6-e647-4b55-86eb-0d69323e3fba req-64605307-36f2-4522-bf6e-ba40e52cd168 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:03.588100 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=1 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:37:03.598713 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.compute.server_external_events [req-d8414ea6-e647-4b55-86eb-0d69323e3fba req-64605307-36f2-4522-bf6e-ba40e52cd168 service nova] Creating event network-vif-deleted:f09c6fe2-495b-40c6-ab14-1c805dd88322 for instance 304c3216-3e08-4ea0-9ca4-ab7d78a952a9 on hv-cinder-86001 Sep 30 19:37:03.604817 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [req-d8414ea6-e647-4b55-86eb-0d69323e3fba req-64605307-36f2-4522-bf6e-ba40e52cd168 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039289 Sep 30 19:37:03.605561 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 435/834] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:37:03.633634 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-72feebef-f73e-4b76-b0ae-d0c8de13ad3f tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:37:03.635208 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-72feebef-f73e-4b76-b0ae-d0c8de13ad3f tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:37:03.652800 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-72feebef-f73e-4b76-b0ae-d0c8de13ad3f tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:03.653314 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-72feebef-f73e-4b76-b0ae-d0c8de13ad3f tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:03.653764 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-72feebef-f73e-4b76-b0ae-d0c8de13ad3f tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:03.654484 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-72feebef-f73e-4b76-b0ae-d0c8de13ad3f tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:03.658848 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-72feebef-f73e-4b76-b0ae-d0c8de13ad3f tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:03.659434 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-72feebef-f73e-4b76-b0ae-d0c8de13ad3f tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:03.766933 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-72feebef-f73e-4b76-b0ae-d0c8de13ad3f tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:37:03.789170 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-72feebef-f73e-4b76-b0ae-d0c8de13ad3f tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 200 len: 1322 microversion: 2.1 time: 0.158209 Sep 30 19:37:03.791575 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 400/835] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:37:03 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:37:04.819024 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-5fbb5b81-c5bb-48af-9dee-eda8313b65ed tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:37:04.819734 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-5fbb5b81-c5bb-48af-9dee-eda8313b65ed tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:37:04.826902 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5fbb5b81-c5bb-48af-9dee-eda8313b65ed tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:04.827391 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5fbb5b81-c5bb-48af-9dee-eda8313b65ed tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:04.827835 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5fbb5b81-c5bb-48af-9dee-eda8313b65ed tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:04.829227 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5fbb5b81-c5bb-48af-9dee-eda8313b65ed tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:04.829690 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5fbb5b81-c5bb-48af-9dee-eda8313b65ed tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:04.830138 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5fbb5b81-c5bb-48af-9dee-eda8313b65ed tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:04.844307 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.wsgi [None req-5fbb5b81-c5bb-48af-9dee-eda8313b65ed tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] HTTP exception thrown: Instance 304c3216-3e08-4ea0-9ca4-ab7d78a952a9 could not be found. Sep 30 19:37:04.845996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-5fbb5b81-c5bb-48af-9dee-eda8313b65ed tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Request method failure captured: Sep 30 19:37:04.845996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: request: GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 HTTP/1.1 Sep 30 19:37:04.845996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Accept: application/json Sep 30 19:37:04.845996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Accept-Encoding: identity Sep 30 19:37:04.845996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Connection: close Sep 30 19:37:04.845996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Content-Length: 0 Sep 30 19:37:04.845996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Content-Type: application/json Sep 30 19:37:04.845996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Host: 10.222.0.17 Sep 30 19:37:04.845996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Openstack-System-Scope: None Sep 30 19:37:04.845996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: User-Agent: python-urllib3/1.26.12 Sep 30 19:37:04.845996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Auth-Token: gAAAAABjN0OLsm0Q7d1hmxK2ta6SW3ynZ14vpctXWB_vXbqF72it1_tuEuwkY8C7Dgu7_C1glQATQugNpziI_G2R1zPuaBX-l-_Zr75E-WgD7iKGfdhvasTlBqZOY00RXaw3n2dNzTEAy2KbqUHrt8NIeEcg8zeQ-BWzmyFqe71VGZiEhVVhNSo Sep 30 19:37:04.845996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Domain-Id: None Sep 30 19:37:04.845996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Domain-Name: None Sep 30 19:37:04.845996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Identity-Status: Confirmed Sep 30 19:37:04.845996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Is-Admin-Project: True Sep 30 19:37:04.845996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Domain-Id: default Sep 30 19:37:04.845996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Domain-Name: Default Sep 30 19:37:04.845996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Id: ac5815ead619491680fb44af178e9cc0 Sep 30 19:37:04.845996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Name: tempest-AttachVolumeTestJSON-1632686379 Sep 30 19:37:04.845996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Role: member,reader Sep 30 19:37:04.845996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Roles: member,reader Sep 30 19:37:04.847636 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ac5815ead619491680fb44af178e9cc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ac5815ead619491680fb44af178e9cc0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ac5815ead619491680fb44af178e9cc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ac5815ead619491680fb44af178e9cc0"}]}] Sep 30 19:37:04.847636 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant: tempest-AttachVolumeTestJSON-1632686379 Sep 30 19:37:04.847636 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant-Id: ac5815ead619491680fb44af178e9cc0 Sep 30 19:37:04.847636 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1632686379 Sep 30 19:37:04.847636 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User: tempest-AttachVolumeTestJSON-1632686379-project Sep 30 19:37:04.847636 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Domain-Id: default Sep 30 19:37:04.847636 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Domain-Name: Default Sep 30 19:37:04.847636 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Id: a397314cdd52409c920071ae009516af Sep 30 19:37:04.847636 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Name: tempest-AttachVolumeTestJSON-1632686379-project Sep 30 19:37:04.847636 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: method: > Sep 30 19:37:04.847636 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: exception: Instance 304c3216-3e08-4ea0-9ca4-ab7d78a952a9 could not be found. Sep 30 19:37:04.847636 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: action_args: {'id': '304c3216-3e08-4ea0-9ca4-ab7d78a952a9'} Sep 30 19:37:04.848699 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:37:04.848699 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:37:04.848699 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 30 19:37:04.848699 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 30 19:37:04.848699 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 30 19:37:04.848699 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 30 19:37:04.848699 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 30 19:37:04.848699 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 30 19:37:04.848699 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 30 19:37:04.848699 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 30 19:37:04.848699 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 304c3216-3e08-4ea0-9ca4-ab7d78a952a9 could not be found. Sep 30 19:37:04.848699 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:37:04.848699 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:37:04.848699 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:37:04.848699 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:37:04.848699 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:37:04.848699 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:37:04.848699 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:37:04.848699 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:37:04.848699 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:37:04.850278 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:37:04.850278 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 30 19:37:04.850278 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 30 19:37:04.850278 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 30 19:37:04.850278 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 30 19:37:04.850278 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 30 19:37:04.850278 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 30 19:37:04.850278 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 304c3216-3e08-4ea0-9ca4-ab7d78a952a9 could not be found. Sep 30 19:37:04.850278 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:37:04.850278 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:37:04.850278 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:37:04.850278 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:37:04.850278 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:37:04.850278 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:37:04.850278 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:37:04.850278 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:37:04.850278 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 304c3216-3e08-4ea0-9ca4-ab7d78a952a9 could not be found. Sep 30 19:37:04.850278 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:37:04.851583 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-5fbb5b81-c5bb-48af-9dee-eda8313b65ed tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Returning 404 to user: Instance 304c3216-3e08-4ea0-9ca4-ab7d78a952a9 could not be found. {{(pid=120649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:37:04.851583 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-5fbb5b81-c5bb-48af-9dee-eda8313b65ed tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 404 len: 111 microversion: 2.1 time: 0.033850 Sep 30 19:37:04.851583 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 436/836] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:37:04 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 30 19:37:04.856558 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-ef696206-0b3c-4397-b75a-2204b8786136 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '.version_select at 0x7f621ee770d0>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:37:04.875299 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-ef696206-0b3c-4397-b75a-2204b8786136 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-254540382" status: 202 len: 0 microversion: 2.1 time: 0.022704 Sep 30 19:37:04.875978 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 401/837] 10.222.0.17 () {58 vars in 1218 bytes} [Fri Sep 30 19:37:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-254540382 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 30 19:37:05.525956 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-f676f5c0-5a4a-4323-a5a5-7744e6eba85e tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Action: 'create', calling method: .version_select at 0x7f62225b8670>, body: {"keypair": {"name": "tempest-keypair-662032815", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDncjmLZN0zh3N9nxKke7/Y3v4KLnaj8iruywmUVD7gP6yxnaPmI4kOPRCPlJN1c73TpERkKmA0c2ehIAdcq76cJ8f0sdxV0jjRupYeZHNY291Xu1r7wquBg7xzWrhe0gQ=="}} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:37:05.542001 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.quota [None req-f676f5c0-5a4a-4323-a5a5-7744e6eba85e tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Getting quotas for project ac5815ead619491680fb44af178e9cc0. Resources: {'key_pairs'} {{(pid=120649) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 30 19:37:05.545945 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.quota [None req-f676f5c0-5a4a-4323-a5a5-7744e6eba85e tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Getting quotas for user a397314cdd52409c920071ae009516af and project ac5815ead619491680fb44af178e9cc0. Resources: {'key_pairs'} {{(pid=120649) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 30 19:37:05.569936 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-f676f5c0-5a4a-4323-a5a5-7744e6eba85e tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047726 Sep 30 19:37:05.570530 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 437/838] 10.222.0.17 () {60 vars in 1159 bytes} [Fri Sep 30 19:37:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:37:06.891248 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-6f869128-a91b-41f3-895d-932dd429be65 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1322002956", "imageRef": "7714d055-7d2c-4f56-9b14-45324361e286", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e825309b-fa06-4059-8fbc-66e6421aaeab"}], "security_groups": [{"name": "tempest-securitygroup--839436284"}], "key_name": "tempest-keypair-662032815", "user_data": "}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:37:07.007929 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.network.neutron [None req-6f869128-a91b-41f3-895d-932dd429be65 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] validate_networks() for [('e825309b-fa06-4059-8fbc-66e6421aaeab', None, None, None, None, None)] {{(pid=120648) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 30 19:37:07.381779 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-6f869128-a91b-41f3-895d-932dd429be65 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Flavor limits 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 30 19:37:07.382209 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-6f869128-a91b-41f3-895d-932dd429be65 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Image limits 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 30 19:37:07.382769 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-6f869128-a91b-41f3-895d-932dd429be65 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Flavor pref 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 30 19:37:07.383190 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-6f869128-a91b-41f3-895d-932dd429be65 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Image pref 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 30 19:37:07.383611 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-6f869128-a91b-41f3-895d-932dd429be65 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 30 19:37:07.392747 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6f869128-a91b-41f3-895d-932dd429be65 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:07.393345 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6f869128-a91b-41f3-895d-932dd429be65 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:07.393968 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6f869128-a91b-41f3-895d-932dd429be65 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:07.395092 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6f869128-a91b-41f3-895d-932dd429be65 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:07.395690 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6f869128-a91b-41f3-895d-932dd429be65 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:07.396877 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6f869128-a91b-41f3-895d-932dd429be65 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:07.418691 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-6f869128-a91b-41f3-895d-932dd429be65 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Getting quotas for project ac5815ead619491680fb44af178e9cc0. Resources: {'instances', 'ram', 'cores'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 30 19:37:07.423668 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-6f869128-a91b-41f3-895d-932dd429be65 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Getting quotas for user a397314cdd52409c920071ae009516af and project ac5815ead619491680fb44af178e9cc0. Resources: {'instances', 'ram', 'cores'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 30 19:37:07.436529 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-6f869128-a91b-41f3-895d-932dd429be65 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Going to run 1 instances... {{(pid=120648) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 30 19:37:07.439360 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-6f869128-a91b-41f3-895d-932dd429be65 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: a7814c9b-5724-412b-9a58-99504793c39e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7714d055-7d2c-4f56-9b14-45324361e286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 30 19:37:07.498493 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-6f869128-a91b-41f3-895d-932dd429be65 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.612664 Sep 30 19:37:07.499206 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 402/839] 10.222.0.17 () {60 vars in 1147 bytes} [Fri Sep 30 19:37:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 30 19:37:07.511139 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-6a517e2f-e3b7-4b32-b060-bd8a589a84f6 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:37:07.511728 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-6a517e2f-e3b7-4b32-b060-bd8a589a84f6 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: a7814c9b-5724-412b-9a58-99504793c39e] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:37:07.582570 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-6a517e2f-e3b7-4b32-b060-bd8a589a84f6 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:37:07.589834 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-6a517e2f-e3b7-4b32-b060-bd8a589a84f6 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e" status: 200 len: 1237 microversion: 2.1 time: 0.083057 Sep 30 19:37:07.590395 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 438/840] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:37:07 2022] GET /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e => generated 1237 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:37:08.612699 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-a9152d76-dd9e-42fc-a79a-f8cd39058ba7 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:37:08.613350 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-a9152d76-dd9e-42fc-a79a-f8cd39058ba7 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: a7814c9b-5724-412b-9a58-99504793c39e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:37:08.620687 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a9152d76-dd9e-42fc-a79a-f8cd39058ba7 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:08.621202 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a9152d76-dd9e-42fc-a79a-f8cd39058ba7 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:08.621837 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a9152d76-dd9e-42fc-a79a-f8cd39058ba7 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:08.622746 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a9152d76-dd9e-42fc-a79a-f8cd39058ba7 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:08.623406 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a9152d76-dd9e-42fc-a79a-f8cd39058ba7 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:08.623840 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a9152d76-dd9e-42fc-a79a-f8cd39058ba7 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:08.739314 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-a9152d76-dd9e-42fc-a79a-f8cd39058ba7 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:37:08.748683 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-a9152d76-dd9e-42fc-a79a-f8cd39058ba7 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e" status: 200 len: 1297 microversion: 2.1 time: 0.139658 Sep 30 19:37:08.749879 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 403/841] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:37:08 2022] GET /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e => generated 1297 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:37:09.775331 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-a9c2686a-5d4b-48b8-8648-1ef14bc7819b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:37:09.775991 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-a9c2686a-5d4b-48b8-8648-1ef14bc7819b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: a7814c9b-5724-412b-9a58-99504793c39e] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:37:09.782392 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a9c2686a-5d4b-48b8-8648-1ef14bc7819b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:09.783077 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a9c2686a-5d4b-48b8-8648-1ef14bc7819b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:09.783582 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a9c2686a-5d4b-48b8-8648-1ef14bc7819b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:09.784355 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a9c2686a-5d4b-48b8-8648-1ef14bc7819b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:09.785179 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a9c2686a-5d4b-48b8-8648-1ef14bc7819b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:09.785693 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a9c2686a-5d4b-48b8-8648-1ef14bc7819b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:09.925881 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-a9c2686a-5d4b-48b8-8648-1ef14bc7819b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:37:09.940668 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-a9c2686a-5d4b-48b8-8648-1ef14bc7819b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e" status: 200 len: 1362 microversion: 2.1 time: 0.168770 Sep 30 19:37:09.941349 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 439/842] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:37:09 2022] GET /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:37:10.190771 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-f5d6bfce-6c54-4525-b1e9-466857382d42 req-ef9cc5fe-6bdb-41da-8097-f2b869b1b09d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7814c9b-5724-412b-9a58-99504793c39e", "tag": "0b4dd313-eeeb-4b83-8c51-6bb29d093b1e"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:37:10.201007 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-f5d6bfce-6c54-4525-b1e9-466857382d42 req-ef9cc5fe-6bdb-41da-8097-f2b869b1b09d service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:10.201492 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-f5d6bfce-6c54-4525-b1e9-466857382d42 req-ef9cc5fe-6bdb-41da-8097-f2b869b1b09d service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:10.201922 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-f5d6bfce-6c54-4525-b1e9-466857382d42 req-ef9cc5fe-6bdb-41da-8097-f2b869b1b09d service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:10.213427 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-f5d6bfce-6c54-4525-b1e9-466857382d42 req-ef9cc5fe-6bdb-41da-8097-f2b869b1b09d service nova] Creating event network-changed:0b4dd313-eeeb-4b83-8c51-6bb29d093b1e for instance a7814c9b-5724-412b-9a58-99504793c39e on hv-cinder-86001 Sep 30 19:37:10.218195 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-f5d6bfce-6c54-4525-b1e9-466857382d42 req-ef9cc5fe-6bdb-41da-8097-f2b869b1b09d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031074 Sep 30 19:37:10.218787 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 404/843] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 30 19:37:10.965832 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-888cd9a0-0024-42b9-be05-51a1b0495e91 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:37:10.968403 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-888cd9a0-0024-42b9-be05-51a1b0495e91 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: a7814c9b-5724-412b-9a58-99504793c39e] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:37:10.973095 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-888cd9a0-0024-42b9-be05-51a1b0495e91 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:10.973602 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-888cd9a0-0024-42b9-be05-51a1b0495e91 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:10.974254 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-888cd9a0-0024-42b9-be05-51a1b0495e91 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:10.975266 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-888cd9a0-0024-42b9-be05-51a1b0495e91 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:10.975918 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-888cd9a0-0024-42b9-be05-51a1b0495e91 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:10.976536 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-888cd9a0-0024-42b9-be05-51a1b0495e91 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:11.112623 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-888cd9a0-0024-42b9-be05-51a1b0495e91 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:37:11.120519 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-888cd9a0-0024-42b9-be05-51a1b0495e91 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e" status: 200 len: 1362 microversion: 2.1 time: 0.158664 Sep 30 19:37:11.121255 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 440/844] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:37:10 2022] GET /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:37:12.144102 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-11f90a05-64d5-4cf4-97f6-a20b222398fe tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:37:12.144890 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-11f90a05-64d5-4cf4-97f6-a20b222398fe tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: a7814c9b-5724-412b-9a58-99504793c39e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:37:12.150925 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-11f90a05-64d5-4cf4-97f6-a20b222398fe tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:12.151409 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-11f90a05-64d5-4cf4-97f6-a20b222398fe tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:12.151845 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-11f90a05-64d5-4cf4-97f6-a20b222398fe tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:12.152574 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-11f90a05-64d5-4cf4-97f6-a20b222398fe tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:12.153032 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-11f90a05-64d5-4cf4-97f6-a20b222398fe tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:12.153456 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-11f90a05-64d5-4cf4-97f6-a20b222398fe tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:12.283771 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-11f90a05-64d5-4cf4-97f6-a20b222398fe tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:37:12.292254 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-11f90a05-64d5-4cf4-97f6-a20b222398fe tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e" status: 200 len: 1362 microversion: 2.1 time: 0.152998 Sep 30 19:37:12.292838 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 405/845] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:37:12 2022] GET /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:37:13.315261 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-da239e21-e47f-4d84-b421-2000202ac80d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:37:13.315987 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-da239e21-e47f-4d84-b421-2000202ac80d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: a7814c9b-5724-412b-9a58-99504793c39e] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:37:13.322450 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-da239e21-e47f-4d84-b421-2000202ac80d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:13.323046 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-da239e21-e47f-4d84-b421-2000202ac80d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:13.323553 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-da239e21-e47f-4d84-b421-2000202ac80d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:13.324334 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-da239e21-e47f-4d84-b421-2000202ac80d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:13.324954 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-da239e21-e47f-4d84-b421-2000202ac80d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:13.325389 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-da239e21-e47f-4d84-b421-2000202ac80d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:13.469425 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-da239e21-e47f-4d84-b421-2000202ac80d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:37:13.479272 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-da239e21-e47f-4d84-b421-2000202ac80d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e" status: 200 len: 1362 microversion: 2.1 time: 0.167763 Sep 30 19:37:13.479951 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 441/846] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:37:13 2022] GET /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:37:14.501885 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-901efe1a-6aa7-4c28-98bd-95928f3b0f49 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:37:14.502512 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-901efe1a-6aa7-4c28-98bd-95928f3b0f49 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: a7814c9b-5724-412b-9a58-99504793c39e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:37:14.508743 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-901efe1a-6aa7-4c28-98bd-95928f3b0f49 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:14.509295 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-901efe1a-6aa7-4c28-98bd-95928f3b0f49 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:14.509799 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-901efe1a-6aa7-4c28-98bd-95928f3b0f49 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:14.510559 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-901efe1a-6aa7-4c28-98bd-95928f3b0f49 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:14.511087 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-901efe1a-6aa7-4c28-98bd-95928f3b0f49 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:14.511604 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-901efe1a-6aa7-4c28-98bd-95928f3b0f49 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:14.669690 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-901efe1a-6aa7-4c28-98bd-95928f3b0f49 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:37:14.680865 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-901efe1a-6aa7-4c28-98bd-95928f3b0f49 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e" status: 200 len: 1362 microversion: 2.1 time: 0.182745 Sep 30 19:37:14.682102 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 406/847] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:37:14 2022] GET /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:37:15.703265 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-8d0a0021-c742-4b79-9943-c6cbb0f9ecef tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:37:15.703890 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-8d0a0021-c742-4b79-9943-c6cbb0f9ecef tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: a7814c9b-5724-412b-9a58-99504793c39e] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:37:15.710348 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8d0a0021-c742-4b79-9943-c6cbb0f9ecef tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:15.710841 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8d0a0021-c742-4b79-9943-c6cbb0f9ecef tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:15.711290 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8d0a0021-c742-4b79-9943-c6cbb0f9ecef tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:15.711999 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8d0a0021-c742-4b79-9943-c6cbb0f9ecef tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:15.712492 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8d0a0021-c742-4b79-9943-c6cbb0f9ecef tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:15.712928 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8d0a0021-c742-4b79-9943-c6cbb0f9ecef tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:15.865870 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-8d0a0021-c742-4b79-9943-c6cbb0f9ecef tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:37:15.874049 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-8d0a0021-c742-4b79-9943-c6cbb0f9ecef tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e" status: 200 len: 1362 microversion: 2.1 time: 0.174649 Sep 30 19:37:15.874635 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 442/848] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:37:15 2022] GET /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:37:16.898675 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-7b1fadc1-a698-4f72-89ad-0eeb3192840a tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:37:16.899410 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-7b1fadc1-a698-4f72-89ad-0eeb3192840a tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: a7814c9b-5724-412b-9a58-99504793c39e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:37:16.901869 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:37:16.907112 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7b1fadc1-a698-4f72-89ad-0eeb3192840a tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:16.907597 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7b1fadc1-a698-4f72-89ad-0eeb3192840a tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:16.908033 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7b1fadc1-a698-4f72-89ad-0eeb3192840a tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:16.908757 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7b1fadc1-a698-4f72-89ad-0eeb3192840a tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:16.909213 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7b1fadc1-a698-4f72-89ad-0eeb3192840a tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:16.910103 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7b1fadc1-a698-4f72-89ad-0eeb3192840a tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:17.045053 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-7b1fadc1-a698-4f72-89ad-0eeb3192840a tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:37:17.052998 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-7b1fadc1-a698-4f72-89ad-0eeb3192840a tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e" status: 200 len: 1362 microversion: 2.1 time: 0.158541 Sep 30 19:37:17.053557 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 407/849] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:37:16 2022] GET /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:37:17.932183 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [req-9209d78d-66b9-4d6f-a3fb-68b26b61ce6d req-d7861205-3199-4158-9672-6fe164c6840a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7814c9b-5724-412b-9a58-99504793c39e", "name": "network-vif-plugged", "status": "completed", "tag": "0b4dd313-eeeb-4b83-8c51-6bb29d093b1e"}]} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:37:17.938142 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell0:SELECT=6 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:37:17.945016 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-9209d78d-66b9-4d6f-a3fb-68b26b61ce6d req-d7861205-3199-4158-9672-6fe164c6840a service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:17.945501 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-9209d78d-66b9-4d6f-a3fb-68b26b61ce6d req-d7861205-3199-4158-9672-6fe164c6840a service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:17.945939 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-9209d78d-66b9-4d6f-a3fb-68b26b61ce6d req-d7861205-3199-4158-9672-6fe164c6840a service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:17.960302 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.compute.server_external_events [req-9209d78d-66b9-4d6f-a3fb-68b26b61ce6d req-d7861205-3199-4158-9672-6fe164c6840a service nova] Creating event network-vif-plugged:0b4dd313-eeeb-4b83-8c51-6bb29d093b1e for instance a7814c9b-5724-412b-9a58-99504793c39e on hv-cinder-86001 Sep 30 19:37:17.968825 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [req-9209d78d-66b9-4d6f-a3fb-68b26b61ce6d req-d7861205-3199-4158-9672-6fe164c6840a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040284 Sep 30 19:37:17.969459 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 443/850] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:37:18.076357 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-34f6ead9-840c-46b0-9c67-37f55f4fd011 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:37:18.077643 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-34f6ead9-840c-46b0-9c67-37f55f4fd011 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: a7814c9b-5724-412b-9a58-99504793c39e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:37:18.079682 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=2 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:37:18.080409 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=6 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:37:18.086365 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-34f6ead9-840c-46b0-9c67-37f55f4fd011 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:18.086862 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-34f6ead9-840c-46b0-9c67-37f55f4fd011 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:18.087309 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-34f6ead9-840c-46b0-9c67-37f55f4fd011 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:18.088011 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-34f6ead9-840c-46b0-9c67-37f55f4fd011 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:18.088515 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-34f6ead9-840c-46b0-9c67-37f55f4fd011 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:18.088949 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-34f6ead9-840c-46b0-9c67-37f55f4fd011 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:18.225416 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-34f6ead9-840c-46b0-9c67-37f55f4fd011 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:37:18.232976 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-34f6ead9-840c-46b0-9c67-37f55f4fd011 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e" status: 200 len: 1362 microversion: 2.1 time: 0.160718 Sep 30 19:37:18.233549 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 408/851] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:37:18 2022] GET /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:37:19.257636 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-8674b87d-b198-45dc-9fe7-c752ccc93a4e tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:37:19.258336 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-8674b87d-b198-45dc-9fe7-c752ccc93a4e tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: a7814c9b-5724-412b-9a58-99504793c39e] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:37:19.266081 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8674b87d-b198-45dc-9fe7-c752ccc93a4e tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:19.266081 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8674b87d-b198-45dc-9fe7-c752ccc93a4e tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:19.266081 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8674b87d-b198-45dc-9fe7-c752ccc93a4e tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:19.266570 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8674b87d-b198-45dc-9fe7-c752ccc93a4e tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:19.267029 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8674b87d-b198-45dc-9fe7-c752ccc93a4e tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:19.267556 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8674b87d-b198-45dc-9fe7-c752ccc93a4e tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:19.409282 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-8674b87d-b198-45dc-9fe7-c752ccc93a4e tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:37:19.417362 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-8674b87d-b198-45dc-9fe7-c752ccc93a4e tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e" status: 200 len: 1362 microversion: 2.1 time: 0.164372 Sep 30 19:37:19.417926 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 444/852] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:37:19 2022] GET /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:37:20.441405 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e91829e1-73a1-4e02-bf9e-e5acb47fc9c5 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:37:20.442107 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-e91829e1-73a1-4e02-bf9e-e5acb47fc9c5 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: a7814c9b-5724-412b-9a58-99504793c39e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:37:20.449067 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e91829e1-73a1-4e02-bf9e-e5acb47fc9c5 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:20.449633 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e91829e1-73a1-4e02-bf9e-e5acb47fc9c5 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:20.450146 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e91829e1-73a1-4e02-bf9e-e5acb47fc9c5 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:20.450919 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e91829e1-73a1-4e02-bf9e-e5acb47fc9c5 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:20.451474 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e91829e1-73a1-4e02-bf9e-e5acb47fc9c5 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:20.451990 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e91829e1-73a1-4e02-bf9e-e5acb47fc9c5 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:20.594627 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-e91829e1-73a1-4e02-bf9e-e5acb47fc9c5 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:37:20.604425 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-e91829e1-73a1-4e02-bf9e-e5acb47fc9c5 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e" status: 200 len: 1549 microversion: 2.1 time: 0.166829 Sep 30 19:37:20.616696 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 409/853] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:37:20 2022] GET /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e => generated 1549 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:37:20.629844 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-0660a0f0-0772-4358-8cf9-ac500f93469d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:37:20.630931 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-0660a0f0-0772-4358-8cf9-ac500f93469d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: a7814c9b-5724-412b-9a58-99504793c39e] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:37:20.637275 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0660a0f0-0772-4358-8cf9-ac500f93469d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:20.637982 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0660a0f0-0772-4358-8cf9-ac500f93469d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:20.638430 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0660a0f0-0772-4358-8cf9-ac500f93469d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:20.639140 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0660a0f0-0772-4358-8cf9-ac500f93469d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:20.639600 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0660a0f0-0772-4358-8cf9-ac500f93469d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:20.640031 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0660a0f0-0772-4358-8cf9-ac500f93469d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:20.726178 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-0660a0f0-0772-4358-8cf9-ac500f93469d tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100167 Sep 30 19:37:20.726781 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 445/854] 10.222.0.17 () {58 vars in 1275 bytes} [Fri Sep 30 19:37:20 2022] GET /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:37:21.694490 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-190b9ce6-3e71-4fc7-b9f6-41df53b942be req-44bd2b06-0d52-4138-b79f-1a832ae0fc7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7814c9b-5724-412b-9a58-99504793c39e", "tag": "0b4dd313-eeeb-4b83-8c51-6bb29d093b1e"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:37:21.704854 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-190b9ce6-3e71-4fc7-b9f6-41df53b942be req-44bd2b06-0d52-4138-b79f-1a832ae0fc7d service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:21.705189 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-190b9ce6-3e71-4fc7-b9f6-41df53b942be req-44bd2b06-0d52-4138-b79f-1a832ae0fc7d service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:21.705852 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-190b9ce6-3e71-4fc7-b9f6-41df53b942be req-44bd2b06-0d52-4138-b79f-1a832ae0fc7d service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:21.717290 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-190b9ce6-3e71-4fc7-b9f6-41df53b942be req-44bd2b06-0d52-4138-b79f-1a832ae0fc7d service nova] Creating event network-changed:0b4dd313-eeeb-4b83-8c51-6bb29d093b1e for instance a7814c9b-5724-412b-9a58-99504793c39e on hv-cinder-86001 Sep 30 19:37:21.722341 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-190b9ce6-3e71-4fc7-b9f6-41df53b942be req-44bd2b06-0d52-4138-b79f-1a832ae0fc7d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032089 Sep 30 19:37:21.723307 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 410/855] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:37:31.244836 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:37:31.246246 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell1:SELECT=39 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:37:31.249994 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-86200de5-5744-4530-ab69-19cd8b5b3bf9 req-e14124e3-aa7b-41d9-a482-546a76ef9919 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4d9e349-e05e-43c7-ac04-37d75ee740ab", "tag": "b73129fe-b689-4fff-8b47-dd8833dbebb1"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:37:31.250596 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-b8c2f3a8-c58e-4ef9-9ead-17d0354f5d4a tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:37:31.251195 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-b8c2f3a8-c58e-4ef9-9ead-17d0354f5d4a tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:37:31.260518 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b8c2f3a8-c58e-4ef9-9ead-17d0354f5d4a tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:31.260948 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-86200de5-5744-4530-ab69-19cd8b5b3bf9 req-e14124e3-aa7b-41d9-a482-546a76ef9919 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:31.261068 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b8c2f3a8-c58e-4ef9-9ead-17d0354f5d4a tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:31.261431 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-86200de5-5744-4530-ab69-19cd8b5b3bf9 req-e14124e3-aa7b-41d9-a482-546a76ef9919 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:31.261559 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b8c2f3a8-c58e-4ef9-9ead-17d0354f5d4a tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:31.261857 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-86200de5-5744-4530-ab69-19cd8b5b3bf9 req-e14124e3-aa7b-41d9-a482-546a76ef9919 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:31.262128 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b8c2f3a8-c58e-4ef9-9ead-17d0354f5d4a tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:31.262584 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b8c2f3a8-c58e-4ef9-9ead-17d0354f5d4a tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:31.263315 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b8c2f3a8-c58e-4ef9-9ead-17d0354f5d4a tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:31.266185 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:37:31.274749 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-86200de5-5744-4530-ab69-19cd8b5b3bf9 req-e14124e3-aa7b-41d9-a482-546a76ef9919 service nova] Creating event network-changed:b73129fe-b689-4fff-8b47-dd8833dbebb1 for instance e4d9e349-e05e-43c7-ac04-37d75ee740ab on hv-cinder-86001 Sep 30 19:37:31.280282 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-86200de5-5744-4530-ab69-19cd8b5b3bf9 req-e14124e3-aa7b-41d9-a482-546a76ef9919 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034361 Sep 30 19:37:31.281326 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 411/856] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:37:31.290687 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-b8c2f3a8-c58e-4ef9-9ead-17d0354f5d4a tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Going to try to terminate instance {{(pid=120649) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 30 19:37:31.366904 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-b8c2f3a8-c58e-4ef9-9ead-17d0354f5d4a tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 204 len: 0 microversion: 2.1 time: 0.123452 Sep 30 19:37:31.367422 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 446/857] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 30 19:37:31 2022] DELETE /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 30 19:37:31.375846 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-9d6fd823-06ba-43cd-a4f3-ebc7f8cbdcc3 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:37:31.376591 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-9d6fd823-06ba-43cd-a4f3-ebc7f8cbdcc3 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:37:31.383474 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9d6fd823-06ba-43cd-a4f3-ebc7f8cbdcc3 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:31.384199 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9d6fd823-06ba-43cd-a4f3-ebc7f8cbdcc3 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:31.384662 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9d6fd823-06ba-43cd-a4f3-ebc7f8cbdcc3 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:31.385349 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9d6fd823-06ba-43cd-a4f3-ebc7f8cbdcc3 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:31.385800 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9d6fd823-06ba-43cd-a4f3-ebc7f8cbdcc3 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:31.386228 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9d6fd823-06ba-43cd-a4f3-ebc7f8cbdcc3 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:31.521230 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-9d6fd823-06ba-43cd-a4f3-ebc7f8cbdcc3 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:37:31.529017 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-9d6fd823-06ba-43cd-a4f3-ebc7f8cbdcc3 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1569 microversion: 2.1 time: 0.157227 Sep 30 19:37:31.529593 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 412/858] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:37:31 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:37:32.554786 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-441e9e57-8d75-4740-9bc4-8979e75851b9 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:37:32.555478 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-441e9e57-8d75-4740-9bc4-8979e75851b9 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:37:32.561793 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-441e9e57-8d75-4740-9bc4-8979e75851b9 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:32.562274 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-441e9e57-8d75-4740-9bc4-8979e75851b9 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:32.562706 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-441e9e57-8d75-4740-9bc4-8979e75851b9 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:32.563384 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-441e9e57-8d75-4740-9bc4-8979e75851b9 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:32.563834 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-441e9e57-8d75-4740-9bc4-8979e75851b9 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:32.564253 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-441e9e57-8d75-4740-9bc4-8979e75851b9 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:32.693723 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-441e9e57-8d75-4740-9bc4-8979e75851b9 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:37:32.701855 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-441e9e57-8d75-4740-9bc4-8979e75851b9 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1569 microversion: 2.1 time: 0.151317 Sep 30 19:37:32.702418 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 447/859] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:37:32 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:37:33.724779 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-9dd41c0f-0ac3-4627-a118-5276f94426e4 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:37:33.725449 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-9dd41c0f-0ac3-4627-a118-5276f94426e4 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:37:33.731717 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9dd41c0f-0ac3-4627-a118-5276f94426e4 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:33.732191 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9dd41c0f-0ac3-4627-a118-5276f94426e4 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:33.732661 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9dd41c0f-0ac3-4627-a118-5276f94426e4 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:33.733338 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9dd41c0f-0ac3-4627-a118-5276f94426e4 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:33.733794 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9dd41c0f-0ac3-4627-a118-5276f94426e4 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:33.734211 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9dd41c0f-0ac3-4627-a118-5276f94426e4 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:33.862464 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-9dd41c0f-0ac3-4627-a118-5276f94426e4 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:37:33.870639 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-9dd41c0f-0ac3-4627-a118-5276f94426e4 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1569 microversion: 2.1 time: 0.149680 Sep 30 19:37:33.871233 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 413/860] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:37:33 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:37:34.893943 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-892eb85d-5be1-4f0e-a925-bd2e9dd3f264 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:37:34.894559 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-892eb85d-5be1-4f0e-a925-bd2e9dd3f264 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:37:34.901882 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-892eb85d-5be1-4f0e-a925-bd2e9dd3f264 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:34.902369 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-892eb85d-5be1-4f0e-a925-bd2e9dd3f264 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:34.902810 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-892eb85d-5be1-4f0e-a925-bd2e9dd3f264 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:34.903499 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-892eb85d-5be1-4f0e-a925-bd2e9dd3f264 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:34.903955 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-892eb85d-5be1-4f0e-a925-bd2e9dd3f264 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:34.904401 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-892eb85d-5be1-4f0e-a925-bd2e9dd3f264 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:35.041582 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-892eb85d-5be1-4f0e-a925-bd2e9dd3f264 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:37:35.049165 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-892eb85d-5be1-4f0e-a925-bd2e9dd3f264 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1569 microversion: 2.1 time: 0.159194 Sep 30 19:37:35.049758 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 448/861] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:37:34 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:37:36.072135 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-f7498759-a565-47b4-b1e9-0a12a8202527 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:37:36.072771 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-f7498759-a565-47b4-b1e9-0a12a8202527 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:37:36.079229 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f7498759-a565-47b4-b1e9-0a12a8202527 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:36.079716 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f7498759-a565-47b4-b1e9-0a12a8202527 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:36.080151 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f7498759-a565-47b4-b1e9-0a12a8202527 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:36.080877 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f7498759-a565-47b4-b1e9-0a12a8202527 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:36.081338 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f7498759-a565-47b4-b1e9-0a12a8202527 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:36.081800 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f7498759-a565-47b4-b1e9-0a12a8202527 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:36.210308 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f7498759-a565-47b4-b1e9-0a12a8202527 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:37:36.218165 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-f7498759-a565-47b4-b1e9-0a12a8202527 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1569 microversion: 2.1 time: 0.149927 Sep 30 19:37:36.218738 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 414/862] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:37:36 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:37:36.285547 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-73cc0c5e-00c4-42ea-b2c5-19a47b56ec72 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:37:36.286091 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-73cc0c5e-00c4-42ea-b2c5-19a47b56ec72 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: 0aa829ac-05b3-4eba-89ed-39195a559ea4] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:37:36.292967 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-73cc0c5e-00c4-42ea-b2c5-19a47b56ec72 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:36.293453 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-73cc0c5e-00c4-42ea-b2c5-19a47b56ec72 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:36.293893 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-73cc0c5e-00c4-42ea-b2c5-19a47b56ec72 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:36.294617 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-73cc0c5e-00c4-42ea-b2c5-19a47b56ec72 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:36.295075 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-73cc0c5e-00c4-42ea-b2c5-19a47b56ec72 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:36.295505 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-73cc0c5e-00c4-42ea-b2c5-19a47b56ec72 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:36.318359 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-73cc0c5e-00c4-42ea-b2c5-19a47b56ec72 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/0aa829ac-05b3-4eba-89ed-39195a559ea4/ips" status: 200 len: 149 microversion: 2.1 time: 0.036923 Sep 30 19:37:36.318926 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 449/863] 10.222.0.17 () {58 vars in 1248 bytes} [Fri Sep 30 19:37:36 2022] GET /compute/v2.1/servers/0aa829ac-05b3-4eba-89ed-39195a559ea4/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:37:37.242076 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-5d2ed206-51c9-4fe0-a806-dce61bc14d81 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:37:37.242690 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-5d2ed206-51c9-4fe0-a806-dce61bc14d81 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:37:37.248645 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5d2ed206-51c9-4fe0-a806-dce61bc14d81 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:37.249121 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5d2ed206-51c9-4fe0-a806-dce61bc14d81 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:37.249550 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5d2ed206-51c9-4fe0-a806-dce61bc14d81 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:37.250225 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5d2ed206-51c9-4fe0-a806-dce61bc14d81 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:37.250672 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5d2ed206-51c9-4fe0-a806-dce61bc14d81 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:37.251091 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5d2ed206-51c9-4fe0-a806-dce61bc14d81 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:37.381473 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-5d2ed206-51c9-4fe0-a806-dce61bc14d81 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:37:37.390091 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-5d2ed206-51c9-4fe0-a806-dce61bc14d81 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1569 microversion: 2.1 time: 0.152339 Sep 30 19:37:37.390676 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 415/864] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:37:37 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:37:38.413427 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-f7d68d97-93d3-4f83-9427-26036cedd9ff tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:37:38.414046 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-f7d68d97-93d3-4f83-9427-26036cedd9ff tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:37:38.420445 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f7d68d97-93d3-4f83-9427-26036cedd9ff tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:38.420938 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f7d68d97-93d3-4f83-9427-26036cedd9ff tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:38.421378 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f7d68d97-93d3-4f83-9427-26036cedd9ff tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:38.422069 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f7d68d97-93d3-4f83-9427-26036cedd9ff tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:38.422528 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f7d68d97-93d3-4f83-9427-26036cedd9ff tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:38.422960 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f7d68d97-93d3-4f83-9427-26036cedd9ff tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:38.553898 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-f7d68d97-93d3-4f83-9427-26036cedd9ff tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:37:38.561584 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-f7d68d97-93d3-4f83-9427-26036cedd9ff tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1569 microversion: 2.1 time: 0.152292 Sep 30 19:37:38.562139 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 450/865] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:37:38 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:37:39.585176 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-2ed93f9e-8e0b-44d6-8dd7-580510885909 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:37:39.596851 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-2ed93f9e-8e0b-44d6-8dd7-580510885909 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:37:39.604271 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2ed93f9e-8e0b-44d6-8dd7-580510885909 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:39.605090 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2ed93f9e-8e0b-44d6-8dd7-580510885909 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:39.605699 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2ed93f9e-8e0b-44d6-8dd7-580510885909 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:39.606505 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2ed93f9e-8e0b-44d6-8dd7-580510885909 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:39.607170 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2ed93f9e-8e0b-44d6-8dd7-580510885909 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:39.607673 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2ed93f9e-8e0b-44d6-8dd7-580510885909 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:39.688725 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-2ed93f9e-8e0b-44d6-8dd7-580510885909 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:37:39.701359 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-2ed93f9e-8e0b-44d6-8dd7-580510885909 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1382 microversion: 2.1 time: 0.119338 Sep 30 19:37:39.720776 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 416/866] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:37:39 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1382 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:37:39.742089 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [req-e4e64123-4064-4450-a9a7-b24fdb0b3d56 req-f4e938b9-824d-4995-8c82-2262951ddc20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4d9e349-e05e-43c7-ac04-37d75ee740ab", "name": "network-vif-deleted", "tag": "b73129fe-b689-4fff-8b47-dd8833dbebb1"}]} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:37:39.752062 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-e4e64123-4064-4450-a9a7-b24fdb0b3d56 req-f4e938b9-824d-4995-8c82-2262951ddc20 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:39.752578 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-e4e64123-4064-4450-a9a7-b24fdb0b3d56 req-f4e938b9-824d-4995-8c82-2262951ddc20 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:39.753565 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-e4e64123-4064-4450-a9a7-b24fdb0b3d56 req-f4e938b9-824d-4995-8c82-2262951ddc20 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:39.769130 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.compute.server_external_events [req-e4e64123-4064-4450-a9a7-b24fdb0b3d56 req-f4e938b9-824d-4995-8c82-2262951ddc20 service nova] Creating event network-vif-deleted:b73129fe-b689-4fff-8b47-dd8833dbebb1 for instance e4d9e349-e05e-43c7-ac04-37d75ee740ab on hv-cinder-86001 Sep 30 19:37:39.775007 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [req-e4e64123-4064-4450-a9a7-b24fdb0b3d56 req-f4e938b9-824d-4995-8c82-2262951ddc20 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046700 Sep 30 19:37:39.776194 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 451/867] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:37:40.727454 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-b3fc31b6-f072-4730-90c6-5dc101ee5957 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:37:40.728094 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-b3fc31b6-f072-4730-90c6-5dc101ee5957 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:37:40.734438 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b3fc31b6-f072-4730-90c6-5dc101ee5957 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:40.734918 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b3fc31b6-f072-4730-90c6-5dc101ee5957 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:40.735353 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b3fc31b6-f072-4730-90c6-5dc101ee5957 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:40.736042 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b3fc31b6-f072-4730-90c6-5dc101ee5957 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:40.736534 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b3fc31b6-f072-4730-90c6-5dc101ee5957 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:40.736960 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b3fc31b6-f072-4730-90c6-5dc101ee5957 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:40.797268 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-b3fc31b6-f072-4730-90c6-5dc101ee5957 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:37:40.806304 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-b3fc31b6-f072-4730-90c6-5dc101ee5957 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1220 microversion: 2.1 time: 0.083037 Sep 30 19:37:40.807192 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 417/868] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:37:40 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:37:40.839816 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-5c0df7bb-1453-4c2c-9198-4bc2cb6f53aa tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a829b957-25c6-427d-9b71-1b1e9fa8dec5"}} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:37:40.842237 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-5c0df7bb-1453-4c2c-9198-4bc2cb6f53aa tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: 0aa829ac-05b3-4eba-89ed-39195a559ea4] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:37:40.848241 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5c0df7bb-1453-4c2c-9198-4bc2cb6f53aa tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:40.848758 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5c0df7bb-1453-4c2c-9198-4bc2cb6f53aa tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:40.849196 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5c0df7bb-1453-4c2c-9198-4bc2cb6f53aa tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:40.849873 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5c0df7bb-1453-4c2c-9198-4bc2cb6f53aa tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:40.850327 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5c0df7bb-1453-4c2c-9198-4bc2cb6f53aa tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:40.850748 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5c0df7bb-1453-4c2c-9198-4bc2cb6f53aa tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:41.831582 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-10681c1c-7750-4ff8-a3c5-ed98bad66df5 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:37:41.832441 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-10681c1c-7750-4ff8-a3c5-ed98bad66df5 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:37:41.839931 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-10681c1c-7750-4ff8-a3c5-ed98bad66df5 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:41.840438 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-10681c1c-7750-4ff8-a3c5-ed98bad66df5 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:41.840872 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-10681c1c-7750-4ff8-a3c5-ed98bad66df5 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:41.841567 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-10681c1c-7750-4ff8-a3c5-ed98bad66df5 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:41.842024 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-10681c1c-7750-4ff8-a3c5-ed98bad66df5 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:41.842444 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-10681c1c-7750-4ff8-a3c5-ed98bad66df5 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:41.907114 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-10681c1c-7750-4ff8-a3c5-ed98bad66df5 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:37:41.915778 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-10681c1c-7750-4ff8-a3c5-ed98bad66df5 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1220 microversion: 2.1 time: 0.088471 Sep 30 19:37:41.916342 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 418/869] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:37:41 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:37:42.937564 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-17561271-a16e-405f-a17a-251aa82d739f tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:37:42.938159 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-17561271-a16e-405f-a17a-251aa82d739f tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:37:42.944512 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-17561271-a16e-405f-a17a-251aa82d739f tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:42.944977 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-17561271-a16e-405f-a17a-251aa82d739f tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:42.945413 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-17561271-a16e-405f-a17a-251aa82d739f tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:42.946096 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-17561271-a16e-405f-a17a-251aa82d739f tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:42.946550 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-17561271-a16e-405f-a17a-251aa82d739f tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:42.946971 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-17561271-a16e-405f-a17a-251aa82d739f tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:43.011382 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-17561271-a16e-405f-a17a-251aa82d739f tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:37:43.018963 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-17561271-a16e-405f-a17a-251aa82d739f tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1220 microversion: 2.1 time: 0.085191 Sep 30 19:37:43.019546 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 419/870] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:37:42 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:37:44.041524 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-3e4a3681-ad95-4a37-8b14-66765b41bf7a tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:37:44.042118 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-3e4a3681-ad95-4a37-8b14-66765b41bf7a tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:37:44.048415 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3e4a3681-ad95-4a37-8b14-66765b41bf7a tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:44.048897 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3e4a3681-ad95-4a37-8b14-66765b41bf7a tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:44.049333 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3e4a3681-ad95-4a37-8b14-66765b41bf7a tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:44.050016 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3e4a3681-ad95-4a37-8b14-66765b41bf7a tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:44.050469 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3e4a3681-ad95-4a37-8b14-66765b41bf7a tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:44.050897 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3e4a3681-ad95-4a37-8b14-66765b41bf7a tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:44.111719 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-3e4a3681-ad95-4a37-8b14-66765b41bf7a tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:37:44.119717 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-3e4a3681-ad95-4a37-8b14-66765b41bf7a tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1220 microversion: 2.1 time: 0.082162 Sep 30 19:37:44.120274 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 420/871] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:37:44 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:37:44.638168 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-5c0df7bb-1453-4c2c-9198-4bc2cb6f53aa tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "POST /compute/v2.1/servers/0aa829ac-05b3-4eba-89ed-39195a559ea4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.802568 Sep 30 19:37:44.638817 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 452/872] 10.222.0.17 () {60 vars in 1323 bytes} [Fri Sep 30 19:37:40 2022] POST /compute/v2.1/servers/0aa829ac-05b3-4eba-89ed-39195a559ea4/os-volume_attachments => generated 194 bytes in 3804 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:37:45.142139 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-3bce77b7-29ac-4e5f-8181-22340b1c2f22 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:37:45.142683 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-3bce77b7-29ac-4e5f-8181-22340b1c2f22 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:37:45.149041 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3bce77b7-29ac-4e5f-8181-22340b1c2f22 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:45.149524 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3bce77b7-29ac-4e5f-8181-22340b1c2f22 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:45.149961 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3bce77b7-29ac-4e5f-8181-22340b1c2f22 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:45.150647 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3bce77b7-29ac-4e5f-8181-22340b1c2f22 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:45.151101 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3bce77b7-29ac-4e5f-8181-22340b1c2f22 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:45.151527 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3bce77b7-29ac-4e5f-8181-22340b1c2f22 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:45.214170 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-3bce77b7-29ac-4e5f-8181-22340b1c2f22 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:37:45.221911 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-3bce77b7-29ac-4e5f-8181-22340b1c2f22 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1220 microversion: 2.1 time: 0.083733 Sep 30 19:37:45.222518 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 421/873] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:37:45 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:37:46.245677 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-979eacb7-b2b4-452a-b455-68d58a42ede7 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:37:46.246905 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-979eacb7-b2b4-452a-b455-68d58a42ede7 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:37:46.254691 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-979eacb7-b2b4-452a-b455-68d58a42ede7 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:46.255190 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-979eacb7-b2b4-452a-b455-68d58a42ede7 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:46.255633 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-979eacb7-b2b4-452a-b455-68d58a42ede7 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:46.256567 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-979eacb7-b2b4-452a-b455-68d58a42ede7 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:46.257588 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-979eacb7-b2b4-452a-b455-68d58a42ede7 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:46.258322 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-979eacb7-b2b4-452a-b455-68d58a42ede7 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:46.291037 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-979eacb7-b2b4-452a-b455-68d58a42ede7 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:46.291544 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-979eacb7-b2b4-452a-b455-68d58a42ede7 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:46.292008 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-979eacb7-b2b4-452a-b455-68d58a42ede7 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:46.292555 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.objects.instance [None req-979eacb7-b2b4-452a-b455-68d58a42ede7 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lazy-loading 'fault' on Instance uuid e4d9e349-e05e-43c7-ac04-37d75ee740ab {{(pid=120649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 30 19:37:46.345712 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-979eacb7-b2b4-452a-b455-68d58a42ede7 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e76ffd048d240ab94ee7e30b261d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e940e1f7e3140f2865594bcdfc427a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:37:46.355118 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-979eacb7-b2b4-452a-b455-68d58a42ede7 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 200 len: 1225 microversion: 2.1 time: 0.114403 Sep 30 19:37:46.355736 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 453/874] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:37:46 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 1225 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:37:47.380291 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-f984651d-e035-43f3-9e00-da9f922973eb tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:37:47.380921 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-f984651d-e035-43f3-9e00-da9f922973eb tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] [instance: e4d9e349-e05e-43c7-ac04-37d75ee740ab] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:37:47.383949 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=30 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:37:47.389277 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f984651d-e035-43f3-9e00-da9f922973eb tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:47.389760 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f984651d-e035-43f3-9e00-da9f922973eb tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:47.390192 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f984651d-e035-43f3-9e00-da9f922973eb tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:47.390881 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f984651d-e035-43f3-9e00-da9f922973eb tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:47.391329 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f984651d-e035-43f3-9e00-da9f922973eb tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:47.391748 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f984651d-e035-43f3-9e00-da9f922973eb tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:47.406049 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.wsgi [None req-f984651d-e035-43f3-9e00-da9f922973eb tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] HTTP exception thrown: Instance e4d9e349-e05e-43c7-ac04-37d75ee740ab could not be found. Sep 30 19:37:47.407754 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-f984651d-e035-43f3-9e00-da9f922973eb tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Request method failure captured: Sep 30 19:37:47.407754 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: request: GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab HTTP/1.1 Sep 30 19:37:47.407754 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 30 19:37:47.407754 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 30 19:37:47.407754 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Connection: close Sep 30 19:37:47.407754 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Length: 0 Sep 30 19:37:47.407754 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 30 19:37:47.407754 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Host: 10.222.0.17 Sep 30 19:37:47.407754 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 30 19:37:47.407754 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 30 19:37:47.407754 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjN0PTgfvIzkDc5ulZe_6W3HwvVnJQBzzGD5Ek_d752TkCNZEFYWM0LZxRbEq2FzUAWozwKoWPOArrfOCvhoGEOCsPRpreCg4AHuSZlcnXnOvoWXeqaXOmi2YdFkmhbuaUEH35_Nc3IMyrD-yw6K1u-K8q-45xsR-o8NA5QmeHd2YtkfI Sep 30 19:37:47.407754 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 30 19:37:47.407754 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 30 19:37:47.407754 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 30 19:37:47.407754 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 30 19:37:47.407754 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 30 19:37:47.407754 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 30 19:37:47.407754 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Id: 4e940e1f7e3140f2865594bcdfc427a0 Sep 30 19:37:47.407754 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-TestShelveInstance-317054205 Sep 30 19:37:47.407754 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 30 19:37:47.407754 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 30 19:37:47.409402 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4e940e1f7e3140f2865594bcdfc427a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4e940e1f7e3140f2865594bcdfc427a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4e940e1f7e3140f2865594bcdfc427a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4e940e1f7e3140f2865594bcdfc427a0"}]}] Sep 30 19:37:47.409402 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-TestShelveInstance-317054205 Sep 30 19:37:47.409402 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Id: 4e940e1f7e3140f2865594bcdfc427a0 Sep 30 19:37:47.409402 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-TestShelveInstance-317054205 Sep 30 19:37:47.409402 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User: tempest-TestShelveInstance-317054205-project Sep 30 19:37:47.409402 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 30 19:37:47.409402 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 30 19:37:47.409402 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Id: 0e76ffd048d240ab94ee7e30b261d3cc Sep 30 19:37:47.409402 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-TestShelveInstance-317054205-project Sep 30 19:37:47.409402 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: method: > Sep 30 19:37:47.409402 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: exception: Instance e4d9e349-e05e-43c7-ac04-37d75ee740ab could not be found. Sep 30 19:37:47.409402 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: action_args: {'id': 'e4d9e349-e05e-43c7-ac04-37d75ee740ab'} Sep 30 19:37:47.410799 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:37:47.410799 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:37:47.410799 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 30 19:37:47.410799 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 30 19:37:47.410799 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 30 19:37:47.410799 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 30 19:37:47.410799 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 30 19:37:47.410799 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 30 19:37:47.410799 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 30 19:37:47.410799 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 30 19:37:47.410799 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4d9e349-e05e-43c7-ac04-37d75ee740ab could not be found. Sep 30 19:37:47.410799 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:37:47.410799 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:37:47.410799 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:37:47.410799 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:37:47.410799 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:37:47.410799 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:37:47.410799 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:37:47.410799 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:37:47.410799 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:37:47.412468 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:37:47.412468 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 30 19:37:47.412468 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 30 19:37:47.412468 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 30 19:37:47.412468 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 30 19:37:47.412468 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 30 19:37:47.412468 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 30 19:37:47.412468 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4d9e349-e05e-43c7-ac04-37d75ee740ab could not be found. Sep 30 19:37:47.412468 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:37:47.412468 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:37:47.412468 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:37:47.412468 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:37:47.412468 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:37:47.412468 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:37:47.412468 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:37:47.412468 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:37:47.412468 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4d9e349-e05e-43c7-ac04-37d75ee740ab could not be found. Sep 30 19:37:47.412468 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:37:47.413957 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-f984651d-e035-43f3-9e00-da9f922973eb tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Returning 404 to user: Instance e4d9e349-e05e-43c7-ac04-37d75ee740ab could not be found. {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:37:47.413957 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-f984651d-e035-43f3-9e00-da9f922973eb tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab" status: 404 len: 111 microversion: 2.1 time: 0.032684 Sep 30 19:37:47.413957 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 422/875] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:37:47 2022] GET /compute/v2.1/servers/e4d9e349-e05e-43c7-ac04-37d75ee740ab => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 30 19:37:47.568504 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-8756b7b5-55b9-4628-b3e7-4233fe6d95a1 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] Calling method '.version_select at 0x7f621ebcd310>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:37:47.593298 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-8756b7b5-55b9-4628-b3e7-4233fe6d95a1 tempest-TestShelveInstance-317054205 tempest-TestShelveInstance-317054205-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1090227529" status: 202 len: 0 microversion: 2.1 time: 0.029472 Sep 30 19:37:47.597379 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 454/876] 10.222.0.17 () {58 vars in 1254 bytes} [Fri Sep 30 19:37:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1090227529 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 30 19:37:53.338307 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-ada1b9b3-8e9a-4c22-af4c-099ef4f55c72 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a829b957-25c6-427d-9b71-1b1e9fa8dec5"}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:37:53.342616 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-ada1b9b3-8e9a-4c22-af4c-099ef4f55c72 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: 0aa829ac-05b3-4eba-89ed-39195a559ea4] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:37:53.349300 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ada1b9b3-8e9a-4c22-af4c-099ef4f55c72 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:53.354149 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ada1b9b3-8e9a-4c22-af4c-099ef4f55c72 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:53.354608 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ada1b9b3-8e9a-4c22-af4c-099ef4f55c72 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:53.355421 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ada1b9b3-8e9a-4c22-af4c-099ef4f55c72 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:53.355797 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ada1b9b3-8e9a-4c22-af4c-099ef4f55c72 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:53.356230 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ada1b9b3-8e9a-4c22-af4c-099ef4f55c72 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:53.500054 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.wsgi [None req-ada1b9b3-8e9a-4c22-af4c-099ef4f55c72 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] HTTP exception thrown: Invalid volume: volume a829b957-25c6-427d-9b71-1b1e9fa8dec5 is already attached to instances: 0aa829ac-05b3-4eba-89ed-39195a559ea4 Sep 30 19:37:53.501690 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-ada1b9b3-8e9a-4c22-af4c-099ef4f55c72 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Request method failure captured: Sep 30 19:37:53.501690 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: request: POST /compute/v2.1/servers/0aa829ac-05b3-4eba-89ed-39195a559ea4/os-volume_attachments HTTP/1.1 Sep 30 19:37:53.501690 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 30 19:37:53.501690 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 30 19:37:53.501690 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Connection: close Sep 30 19:37:53.501690 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Length: 74 Sep 30 19:37:53.501690 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 30 19:37:53.501690 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Host: 10.222.0.17 Sep 30 19:37:53.501690 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 30 19:37:53.501690 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 30 19:37:53.501690 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjN0ONqtIDYC2-7JPJhRMwDTFX77ua7wCzld6d05rw2OAypY6C9ruPlCf9je7iHOPQdEHBIS7fQsYNQwwCaWegqx7UtPiHvBb_B_GTauKCWL_cl9osIiSIgmJPV0ud6nFHwFaWS29rEhsSYVXTP0g-WZEwpi_MPh4YPjuB1sskH-bvyg0 Sep 30 19:37:53.501690 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 30 19:37:53.501690 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 30 19:37:53.501690 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 30 19:37:53.501690 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 30 19:37:53.501690 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 30 19:37:53.501690 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 30 19:37:53.501690 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Id: 612fb8a339e4478ba78bc5ef3b343b82 Sep 30 19:37:53.501690 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-AttachVolumeNegativeTest-1614355089 Sep 30 19:37:53.501690 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 30 19:37:53.501690 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 30 19:37:53.503079 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/612fb8a339e4478ba78bc5ef3b343b82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/612fb8a339e4478ba78bc5ef3b343b82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/612fb8a339e4478ba78bc5ef3b343b82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_612fb8a339e4478ba78bc5ef3b343b82"}]}] Sep 30 19:37:53.503079 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-AttachVolumeNegativeTest-1614355089 Sep 30 19:37:53.503079 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Id: 612fb8a339e4478ba78bc5ef3b343b82 Sep 30 19:37:53.503079 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1614355089 Sep 30 19:37:53.503079 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User: tempest-AttachVolumeNegativeTest-1614355089-project Sep 30 19:37:53.503079 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 30 19:37:53.503079 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 30 19:37:53.503079 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Id: ccbdadc310fc4bf8a6679bcb39b34ff1 Sep 30 19:37:53.503079 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-AttachVolumeNegativeTest-1614355089-project Sep 30 19:37:53.503079 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Sep 30 19:37:53.503079 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: {"volumeAttachment": {"volumeId": "a829b957-25c6-427d-9b71-1b1e9fa8dec5"}} Sep 30 19:37:53.503079 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: method: > Sep 30 19:37:53.503858 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: exception: Invalid volume: volume a829b957-25c6-427d-9b71-1b1e9fa8dec5 is already attached to instances: 0aa829ac-05b3-4eba-89ed-39195a559ea4 Sep 30 19:37:53.503858 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: action_args: {'server_id': '0aa829ac-05b3-4eba-89ed-39195a559ea4', 'body': {'volumeAttachment': {'volumeId': 'a829b957-25c6-427d-9b71-1b1e9fa8dec5'}}} Sep 30 19:37:53.503858 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:37:53.503858 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:37:53.503858 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 30 19:37:53.503858 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 30 19:37:53.503858 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 30 19:37:53.503858 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 30 19:37:53.503858 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 30 19:37:53.503858 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 30 19:37:53.503858 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 30 19:37:53.503858 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 30 19:37:53.503858 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 30 19:37:53.503858 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 30 19:37:53.503858 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a829b957-25c6-427d-9b71-1b1e9fa8dec5 is already attached to instances: 0aa829ac-05b3-4eba-89ed-39195a559ea4 Sep 30 19:37:53.503858 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:37:53.503858 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:37:53.503858 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:37:53.503858 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:37:53.505171 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:37:53.505171 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:37:53.505171 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:37:53.505171 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:37:53.505171 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:37:53.505171 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:37:53.505171 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 30 19:37:53.505171 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 30 19:37:53.505171 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 30 19:37:53.505171 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 30 19:37:53.505171 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 30 19:37:53.505171 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 30 19:37:53.505171 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 30 19:37:53.505171 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 30 19:37:53.505171 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a829b957-25c6-427d-9b71-1b1e9fa8dec5 is already attached to instances: 0aa829ac-05b3-4eba-89ed-39195a559ea4 Sep 30 19:37:53.505171 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:37:53.505171 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:37:53.505171 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:37:53.505171 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:37:53.505171 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:37:53.506807 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:37:53.506807 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:37:53.506807 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:37:53.506807 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a829b957-25c6-427d-9b71-1b1e9fa8dec5 is already attached to instances: 0aa829ac-05b3-4eba-89ed-39195a559ea4 Sep 30 19:37:53.506807 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:37:53.506807 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-ada1b9b3-8e9a-4c22-af4c-099ef4f55c72 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Returning 400 to user: Invalid volume: volume a829b957-25c6-427d-9b71-1b1e9fa8dec5 is already attached to instances: 0aa829ac-05b3-4eba-89ed-39195a559ea4 {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:37:53.506807 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-ada1b9b3-8e9a-4c22-af4c-099ef4f55c72 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "POST /compute/v2.1/servers/0aa829ac-05b3-4eba-89ed-39195a559ea4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.169157 Sep 30 19:37:53.506807 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 423/877] 10.222.0.17 () {60 vars in 1323 bytes} [Fri Sep 30 19:37:53 2022] POST /compute/v2.1/servers/0aa829ac-05b3-4eba-89ed-39195a559ea4/os-volume_attachments => generated 174 bytes in 171 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 30 19:37:53.576761 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-2f9ee840-db4a-41ff-845f-992156175f50 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:37:53.577227 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-2f9ee840-db4a-41ff-845f-992156175f50 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: 0aa829ac-05b3-4eba-89ed-39195a559ea4] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:37:53.584334 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2f9ee840-db4a-41ff-845f-992156175f50 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:53.584905 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2f9ee840-db4a-41ff-845f-992156175f50 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:53.585338 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2f9ee840-db4a-41ff-845f-992156175f50 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:53.586026 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2f9ee840-db4a-41ff-845f-992156175f50 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:53.586482 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2f9ee840-db4a-41ff-845f-992156175f50 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:53.586906 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2f9ee840-db4a-41ff-845f-992156175f50 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:53.666636 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.objects.instance [None req-2f9ee840-db4a-41ff-845f-992156175f50 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lazy-loading 'services' on Instance uuid 0aa829ac-05b3-4eba-89ed-39195a559ea4 {{(pid=120649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 30 19:37:53.747812 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-2f9ee840-db4a-41ff-845f-992156175f50 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0aa829ac-05b3-4eba-89ed-39195a559ea4/os-volume_attachments/a829b957-25c6-427d-9b71-1b1e9fa8dec5" status: 202 len: 0 microversion: 2.1 time: 0.174857 Sep 30 19:37:53.748750 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 455/878] 10.222.0.17 () {58 vars in 1416 bytes} [Fri Sep 30 19:37:53 2022] DELETE /compute/v2.1/servers/0aa829ac-05b3-4eba-89ed-39195a559ea4/os-volume_attachments/a829b957-25c6-427d-9b71-1b1e9fa8dec5 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 30 19:37:53.757839 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-89163ce8-001b-4cd8-807a-7e6d9cd6b16d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:37:53.763638 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-89163ce8-001b-4cd8-807a-7e6d9cd6b16d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: 0aa829ac-05b3-4eba-89ed-39195a559ea4] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:37:53.782313 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-89163ce8-001b-4cd8-807a-7e6d9cd6b16d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:53.783032 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-89163ce8-001b-4cd8-807a-7e6d9cd6b16d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:53.783801 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-89163ce8-001b-4cd8-807a-7e6d9cd6b16d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:53.784610 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-89163ce8-001b-4cd8-807a-7e6d9cd6b16d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:53.785323 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-89163ce8-001b-4cd8-807a-7e6d9cd6b16d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:53.785757 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-89163ce8-001b-4cd8-807a-7e6d9cd6b16d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:53.820804 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-89163ce8-001b-4cd8-807a-7e6d9cd6b16d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/0aa829ac-05b3-4eba-89ed-39195a559ea4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067763 Sep 30 19:37:53.821392 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 424/879] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 30 19:37:53 2022] GET /compute/v2.1/servers/0aa829ac-05b3-4eba-89ed-39195a559ea4/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:37:54.834528 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-e533e8bd-c472-4c6e-ae1e-44bbfbe901cc tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:37:54.836765 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-e533e8bd-c472-4c6e-ae1e-44bbfbe901cc tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: 0aa829ac-05b3-4eba-89ed-39195a559ea4] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:37:54.842861 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e533e8bd-c472-4c6e-ae1e-44bbfbe901cc tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:54.843342 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e533e8bd-c472-4c6e-ae1e-44bbfbe901cc tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:54.843773 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e533e8bd-c472-4c6e-ae1e-44bbfbe901cc tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:54.844482 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e533e8bd-c472-4c6e-ae1e-44bbfbe901cc tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:54.844937 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e533e8bd-c472-4c6e-ae1e-44bbfbe901cc tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:54.845364 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e533e8bd-c472-4c6e-ae1e-44bbfbe901cc tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:54.875771 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-e533e8bd-c472-4c6e-ae1e-44bbfbe901cc tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/0aa829ac-05b3-4eba-89ed-39195a559ea4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045980 Sep 30 19:37:54.876780 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 456/880] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 30 19:37:54 2022] GET /compute/v2.1/servers/0aa829ac-05b3-4eba-89ed-39195a559ea4/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 30 19:37:54.941621 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-99879984-ae37-4f7f-b377-9962d4055e6a tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:37:54.942195 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-99879984-ae37-4f7f-b377-9962d4055e6a tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: 0aa829ac-05b3-4eba-89ed-39195a559ea4] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:37:54.948940 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-99879984-ae37-4f7f-b377-9962d4055e6a tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:54.949494 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-99879984-ae37-4f7f-b377-9962d4055e6a tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:54.950022 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-99879984-ae37-4f7f-b377-9962d4055e6a tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:54.950791 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-99879984-ae37-4f7f-b377-9962d4055e6a tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:54.951322 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-99879984-ae37-4f7f-b377-9962d4055e6a tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:54.951831 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-99879984-ae37-4f7f-b377-9962d4055e6a tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:54.977662 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-99879984-ae37-4f7f-b377-9962d4055e6a tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: 0aa829ac-05b3-4eba-89ed-39195a559ea4] Going to try to terminate instance {{(pid=120648) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 30 19:37:55.052966 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-99879984-ae37-4f7f-b377-9962d4055e6a tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0aa829ac-05b3-4eba-89ed-39195a559ea4" status: 204 len: 0 microversion: 2.1 time: 0.115151 Sep 30 19:37:55.053638 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 425/881] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 30 19:37:54 2022] DELETE /compute/v2.1/servers/0aa829ac-05b3-4eba-89ed-39195a559ea4 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 30 19:37:55.064072 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-892925a9-f0d1-4ceb-ba71-c3bb02946be6 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:37:55.065326 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-892925a9-f0d1-4ceb-ba71-c3bb02946be6 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: 0aa829ac-05b3-4eba-89ed-39195a559ea4] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:37:55.073816 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-892925a9-f0d1-4ceb-ba71-c3bb02946be6 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:55.074305 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-892925a9-f0d1-4ceb-ba71-c3bb02946be6 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:55.074767 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-892925a9-f0d1-4ceb-ba71-c3bb02946be6 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:55.075461 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-892925a9-f0d1-4ceb-ba71-c3bb02946be6 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:55.075912 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-892925a9-f0d1-4ceb-ba71-c3bb02946be6 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:55.076341 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-892925a9-f0d1-4ceb-ba71-c3bb02946be6 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:55.220348 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-892925a9-f0d1-4ceb-ba71-c3bb02946be6 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:37:55.229989 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-892925a9-f0d1-4ceb-ba71-c3bb02946be6 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/0aa829ac-05b3-4eba-89ed-39195a559ea4" status: 200 len: 1682 microversion: 2.1 time: 0.171526 Sep 30 19:37:55.235005 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 457/882] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:37:55 2022] GET /compute/v2.1/servers/0aa829ac-05b3-4eba-89ed-39195a559ea4 => generated 1682 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:37:56.259327 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-f1cade6d-29d6-4605-92b4-f7707abe4f9f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:37:56.260119 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-f1cade6d-29d6-4605-92b4-f7707abe4f9f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: 0aa829ac-05b3-4eba-89ed-39195a559ea4] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:37:56.267177 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f1cade6d-29d6-4605-92b4-f7707abe4f9f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:56.267922 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f1cade6d-29d6-4605-92b4-f7707abe4f9f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:56.268528 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f1cade6d-29d6-4605-92b4-f7707abe4f9f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:56.269704 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f1cade6d-29d6-4605-92b4-f7707abe4f9f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:56.270217 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f1cade6d-29d6-4605-92b4-f7707abe4f9f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:56.270986 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f1cade6d-29d6-4605-92b4-f7707abe4f9f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:56.770013 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f1cade6d-29d6-4605-92b4-f7707abe4f9f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:37:56.779046 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-f1cade6d-29d6-4605-92b4-f7707abe4f9f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/0aa829ac-05b3-4eba-89ed-39195a559ea4" status: 200 len: 1682 microversion: 2.1 time: 0.524252 Sep 30 19:37:56.795631 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 426/883] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:37:56 2022] GET /compute/v2.1/servers/0aa829ac-05b3-4eba-89ed-39195a559ea4 => generated 1682 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:37:57.804260 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-f93eb0b9-5df1-406e-891d-9e77d09399dd tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:37:57.804899 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-f93eb0b9-5df1-406e-891d-9e77d09399dd tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: 0aa829ac-05b3-4eba-89ed-39195a559ea4] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:37:57.813223 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f93eb0b9-5df1-406e-891d-9e77d09399dd tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:57.813634 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f93eb0b9-5df1-406e-891d-9e77d09399dd tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:57.815469 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f93eb0b9-5df1-406e-891d-9e77d09399dd tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:57.816390 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f93eb0b9-5df1-406e-891d-9e77d09399dd tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:57.816859 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f93eb0b9-5df1-406e-891d-9e77d09399dd tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:57.817287 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f93eb0b9-5df1-406e-891d-9e77d09399dd tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:57.888596 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-f93eb0b9-5df1-406e-891d-9e77d09399dd tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:37:57.903273 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-f93eb0b9-5df1-406e-891d-9e77d09399dd tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/0aa829ac-05b3-4eba-89ed-39195a559ea4" status: 200 len: 1614 microversion: 2.1 time: 0.103667 Sep 30 19:37:57.917119 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 458/884] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:37:57 2022] GET /compute/v2.1/servers/0aa829ac-05b3-4eba-89ed-39195a559ea4 => generated 1614 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:37:58.066227 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-d1c87301-d910-4560-83ab-198eb99a4b06 req-5c0ad868-b731-41c9-8262-bb47dd64d3f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0aa829ac-05b3-4eba-89ed-39195a559ea4", "name": "network-vif-deleted", "tag": "3141cbe0-074a-4113-97c5-c6f304ef2036"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:37:58.095599 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-d1c87301-d910-4560-83ab-198eb99a4b06 req-5c0ad868-b731-41c9-8262-bb47dd64d3f6 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:58.098209 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-d1c87301-d910-4560-83ab-198eb99a4b06 req-5c0ad868-b731-41c9-8262-bb47dd64d3f6 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:58.108671 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-d1c87301-d910-4560-83ab-198eb99a4b06 req-5c0ad868-b731-41c9-8262-bb47dd64d3f6 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:58.143392 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-d1c87301-d910-4560-83ab-198eb99a4b06 req-5c0ad868-b731-41c9-8262-bb47dd64d3f6 service nova] Creating event network-vif-deleted:3141cbe0-074a-4113-97c5-c6f304ef2036 for instance 0aa829ac-05b3-4eba-89ed-39195a559ea4 on hv-cinder-86001 Sep 30 19:37:58.154576 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-d1c87301-d910-4560-83ab-198eb99a4b06 req-5c0ad868-b731-41c9-8262-bb47dd64d3f6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093290 Sep 30 19:37:58.156456 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 427/885] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:37:58.929243 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-417df878-7361-408e-9909-cc8331123019 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:37:58.929835 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-417df878-7361-408e-9909-cc8331123019 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: 0aa829ac-05b3-4eba-89ed-39195a559ea4] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:37:58.936432 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-417df878-7361-408e-9909-cc8331123019 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:58.937179 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-417df878-7361-408e-9909-cc8331123019 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:58.937792 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-417df878-7361-408e-9909-cc8331123019 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:58.938835 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-417df878-7361-408e-9909-cc8331123019 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:37:58.939286 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-417df878-7361-408e-9909-cc8331123019 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:37:58.939867 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-417df878-7361-408e-9909-cc8331123019 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:37:58.954081 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.wsgi [None req-417df878-7361-408e-9909-cc8331123019 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] HTTP exception thrown: Instance 0aa829ac-05b3-4eba-89ed-39195a559ea4 could not be found. Sep 30 19:37:58.956169 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-417df878-7361-408e-9909-cc8331123019 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Request method failure captured: Sep 30 19:37:58.956169 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: request: GET /compute/v2.1/servers/0aa829ac-05b3-4eba-89ed-39195a559ea4 HTTP/1.1 Sep 30 19:37:58.956169 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Accept: application/json Sep 30 19:37:58.956169 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Accept-Encoding: identity Sep 30 19:37:58.956169 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Connection: close Sep 30 19:37:58.956169 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Content-Length: 0 Sep 30 19:37:58.956169 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Content-Type: application/json Sep 30 19:37:58.956169 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Host: 10.222.0.17 Sep 30 19:37:58.956169 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Openstack-System-Scope: None Sep 30 19:37:58.956169 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: User-Agent: python-urllib3/1.26.12 Sep 30 19:37:58.956169 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Auth-Token: gAAAAABjN0ONqtIDYC2-7JPJhRMwDTFX77ua7wCzld6d05rw2OAypY6C9ruPlCf9je7iHOPQdEHBIS7fQsYNQwwCaWegqx7UtPiHvBb_B_GTauKCWL_cl9osIiSIgmJPV0ud6nFHwFaWS29rEhsSYVXTP0g-WZEwpi_MPh4YPjuB1sskH-bvyg0 Sep 30 19:37:58.956169 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Domain-Id: None Sep 30 19:37:58.956169 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Domain-Name: None Sep 30 19:37:58.956169 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Identity-Status: Confirmed Sep 30 19:37:58.956169 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Is-Admin-Project: True Sep 30 19:37:58.956169 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Domain-Id: default Sep 30 19:37:58.956169 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Domain-Name: Default Sep 30 19:37:58.956169 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Id: 612fb8a339e4478ba78bc5ef3b343b82 Sep 30 19:37:58.956169 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Name: tempest-AttachVolumeNegativeTest-1614355089 Sep 30 19:37:58.956169 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Role: member,reader Sep 30 19:37:58.956169 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Roles: member,reader Sep 30 19:37:58.957716 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/612fb8a339e4478ba78bc5ef3b343b82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/612fb8a339e4478ba78bc5ef3b343b82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/612fb8a339e4478ba78bc5ef3b343b82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_612fb8a339e4478ba78bc5ef3b343b82"}]}] Sep 30 19:37:58.957716 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant: tempest-AttachVolumeNegativeTest-1614355089 Sep 30 19:37:58.957716 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant-Id: 612fb8a339e4478ba78bc5ef3b343b82 Sep 30 19:37:58.957716 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1614355089 Sep 30 19:37:58.957716 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User: tempest-AttachVolumeNegativeTest-1614355089-project Sep 30 19:37:58.957716 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Domain-Id: default Sep 30 19:37:58.957716 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Domain-Name: Default Sep 30 19:37:58.957716 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Id: ccbdadc310fc4bf8a6679bcb39b34ff1 Sep 30 19:37:58.957716 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Name: tempest-AttachVolumeNegativeTest-1614355089-project Sep 30 19:37:58.957716 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: method: > Sep 30 19:37:58.957716 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: exception: Instance 0aa829ac-05b3-4eba-89ed-39195a559ea4 could not be found. Sep 30 19:37:58.957716 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: action_args: {'id': '0aa829ac-05b3-4eba-89ed-39195a559ea4'} Sep 30 19:37:58.959375 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:37:58.959375 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:37:58.959375 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 30 19:37:58.959375 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 30 19:37:58.959375 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 30 19:37:58.959375 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 30 19:37:58.959375 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 30 19:37:58.959375 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 30 19:37:58.959375 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 30 19:37:58.959375 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 30 19:37:58.959375 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0aa829ac-05b3-4eba-89ed-39195a559ea4 could not be found. Sep 30 19:37:58.959375 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:37:58.959375 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:37:58.959375 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:37:58.959375 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:37:58.959375 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:37:58.959375 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:37:58.959375 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:37:58.959375 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:37:58.959375 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:37:58.962087 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:37:58.962087 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 30 19:37:58.962087 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 30 19:37:58.962087 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 30 19:37:58.962087 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 30 19:37:58.962087 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 30 19:37:58.962087 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 30 19:37:58.962087 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0aa829ac-05b3-4eba-89ed-39195a559ea4 could not be found. Sep 30 19:37:58.962087 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:37:58.962087 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:37:58.962087 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:37:58.962087 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:37:58.962087 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:37:58.962087 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:37:58.962087 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:37:58.962087 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:37:58.962087 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0aa829ac-05b3-4eba-89ed-39195a559ea4 could not be found. Sep 30 19:37:58.962087 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:37:58.963688 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-417df878-7361-408e-9909-cc8331123019 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Returning 404 to user: Instance 0aa829ac-05b3-4eba-89ed-39195a559ea4 could not be found. {{(pid=120649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:37:58.963688 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-417df878-7361-408e-9909-cc8331123019 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/0aa829ac-05b3-4eba-89ed-39195a559ea4" status: 404 len: 111 microversion: 2.1 time: 0.032930 Sep 30 19:37:58.963688 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 459/886] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:37:58 2022] GET /compute/v2.1/servers/0aa829ac-05b3-4eba-89ed-39195a559ea4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 30 19:37:58.968860 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-bb9eb969-5d19-44b1-96a2-73f8c2c0e8ea tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '.version_select at 0x7f621ee7cf70>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:37:58.990110 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-bb9eb969-5d19-44b1-96a2-73f8c2c0e8ea tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1538942225" status: 202 len: 0 microversion: 2.1 time: 0.025203 Sep 30 19:37:58.991480 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 428/887] 10.222.0.17 () {58 vars in 1221 bytes} [Fri Sep 30 19:37:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1538942225 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 30 19:37:59.984045 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-370da8a1-41ed-4783-bf9a-fc212e3a0b44 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Action: 'create', calling method: .version_select at 0x7f62225cf310>, body: {"keypair": {"name": "tempest-keypair-629945437", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMV+bgrPOTINfV3lJqLR72iAOVXWUdnngd0tjpNFelK1hLLjVCgwTE+HeRXAN6vDB/Kre5XJG3CyIw7FjCK2ZJ9edPgy6rY616pNdgPzfVnWke86zBrZgZYH2t69xHkOg=="}} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:38:00.022331 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.quota [None req-370da8a1-41ed-4783-bf9a-fc212e3a0b44 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Getting quotas for project 612fb8a339e4478ba78bc5ef3b343b82. Resources: {'key_pairs'} {{(pid=120649) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 30 19:38:00.027107 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.quota [None req-370da8a1-41ed-4783-bf9a-fc212e3a0b44 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Getting quotas for user ccbdadc310fc4bf8a6679bcb39b34ff1 and project 612fb8a339e4478ba78bc5ef3b343b82. Resources: {'key_pairs'} {{(pid=120649) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 30 19:38:00.055614 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-370da8a1-41ed-4783-bf9a-fc212e3a0b44 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.075363 Sep 30 19:38:00.056515 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 460/888] 10.222.0.17 () {60 vars in 1159 bytes} [Fri Sep 30 19:37:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 30 19:38:01.873360 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-d0f17c05-27f1-4f57-88db-922cb66e1440 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1937066210", "imageRef": "7714d055-7d2c-4f56-9b14-45324361e286", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0c1e5405-3945-456e-8e1d-e94d5c819889"}], "security_groups": [{"name": "tempest-securitygroup--1245421854"}], "key_name": "tempest-keypair-629945437", "user_data": "}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:38:02.321644 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.network.neutron [None req-d0f17c05-27f1-4f57-88db-922cb66e1440 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] validate_networks() for [('0c1e5405-3945-456e-8e1d-e94d5c819889', None, None, None, None, None)] {{(pid=120648) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 30 19:38:02.956973 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-d0f17c05-27f1-4f57-88db-922cb66e1440 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Flavor limits 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 30 19:38:02.957556 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-d0f17c05-27f1-4f57-88db-922cb66e1440 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Image limits 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 30 19:38:02.957998 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-d0f17c05-27f1-4f57-88db-922cb66e1440 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Flavor pref 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 30 19:38:02.958410 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-d0f17c05-27f1-4f57-88db-922cb66e1440 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Image pref 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 30 19:38:02.958817 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-d0f17c05-27f1-4f57-88db-922cb66e1440 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 30 19:38:02.969500 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d0f17c05-27f1-4f57-88db-922cb66e1440 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:02.970237 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d0f17c05-27f1-4f57-88db-922cb66e1440 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:02.970674 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d0f17c05-27f1-4f57-88db-922cb66e1440 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:02.971661 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d0f17c05-27f1-4f57-88db-922cb66e1440 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:02.972284 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d0f17c05-27f1-4f57-88db-922cb66e1440 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:02.972743 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d0f17c05-27f1-4f57-88db-922cb66e1440 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:02.980156 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:38:02.995694 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-d0f17c05-27f1-4f57-88db-922cb66e1440 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Getting quotas for project 612fb8a339e4478ba78bc5ef3b343b82. Resources: {'instances', 'ram', 'cores'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 30 19:38:02.999914 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-d0f17c05-27f1-4f57-88db-922cb66e1440 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Getting quotas for user ccbdadc310fc4bf8a6679bcb39b34ff1 and project 612fb8a339e4478ba78bc5ef3b343b82. Resources: {'instances', 'ram', 'cores'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 30 19:38:03.012933 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-d0f17c05-27f1-4f57-88db-922cb66e1440 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Going to run 1 instances... {{(pid=120648) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 30 19:38:03.015346 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-d0f17c05-27f1-4f57-88db-922cb66e1440 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: 42acb210-bef2-4e45-9b48-ed1c75fdf191] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7714d055-7d2c-4f56-9b14-45324361e286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 30 19:38:03.075108 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-d0f17c05-27f1-4f57-88db-922cb66e1440 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.207454 Sep 30 19:38:03.076031 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 429/889] 10.222.0.17 () {60 vars in 1147 bytes} [Fri Sep 30 19:38:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 1210 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 30 19:38:03.088154 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-d290351a-ab90-44db-997e-3d47af251541 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:03.088797 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-d290351a-ab90-44db-997e-3d47af251541 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: 42acb210-bef2-4e45-9b48-ed1c75fdf191] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:03.097074 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:38:03.224778 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-d290351a-ab90-44db-997e-3d47af251541 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:03.233641 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-d290351a-ab90-44db-997e-3d47af251541 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191" status: 200 len: 1241 microversion: 2.1 time: 0.149876 Sep 30 19:38:03.234229 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 461/890] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:38:03 2022] GET /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191 => generated 1241 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:38:04.261443 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e96a35e7-d283-42da-927d-ed4d59f1cd5e tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:04.262479 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-e96a35e7-d283-42da-927d-ed4d59f1cd5e tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: 42acb210-bef2-4e45-9b48-ed1c75fdf191] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:04.274783 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e96a35e7-d283-42da-927d-ed4d59f1cd5e tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:04.276706 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e96a35e7-d283-42da-927d-ed4d59f1cd5e tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:04.277383 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e96a35e7-d283-42da-927d-ed4d59f1cd5e tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:04.282139 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e96a35e7-d283-42da-927d-ed4d59f1cd5e tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:04.282895 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e96a35e7-d283-42da-927d-ed4d59f1cd5e tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:04.283577 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e96a35e7-d283-42da-927d-ed4d59f1cd5e tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:04.363476 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-e96a35e7-d283-42da-927d-ed4d59f1cd5e tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:04.373155 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-e96a35e7-d283-42da-927d-ed4d59f1cd5e tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191" status: 200 len: 1293 microversion: 2.1 time: 0.115790 Sep 30 19:38:04.373750 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 430/891] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:38:04 2022] GET /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191 => generated 1293 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:38:05.403193 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-0940335f-b70e-4a29-801f-f0e82b40ff1f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:05.405916 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-0940335f-b70e-4a29-801f-f0e82b40ff1f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: 42acb210-bef2-4e45-9b48-ed1c75fdf191] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:05.416410 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0940335f-b70e-4a29-801f-f0e82b40ff1f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:05.417106 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0940335f-b70e-4a29-801f-f0e82b40ff1f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:05.417544 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0940335f-b70e-4a29-801f-f0e82b40ff1f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:05.418250 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0940335f-b70e-4a29-801f-f0e82b40ff1f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:05.418700 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0940335f-b70e-4a29-801f-f0e82b40ff1f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:05.419192 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0940335f-b70e-4a29-801f-f0e82b40ff1f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:05.423484 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:38:05.545422 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-0940335f-b70e-4a29-801f-f0e82b40ff1f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:05.554695 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-0940335f-b70e-4a29-801f-f0e82b40ff1f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191" status: 200 len: 1299 microversion: 2.1 time: 0.161104 Sep 30 19:38:05.556065 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 462/892] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:38:05 2022] GET /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191 => generated 1299 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:38:06.579040 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-ae72612c-1700-4f15-aa3f-015ee5680d0f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:06.580722 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-ae72612c-1700-4f15-aa3f-015ee5680d0f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: 42acb210-bef2-4e45-9b48-ed1c75fdf191] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:06.589164 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ae72612c-1700-4f15-aa3f-015ee5680d0f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:06.589950 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ae72612c-1700-4f15-aa3f-015ee5680d0f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:06.591049 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ae72612c-1700-4f15-aa3f-015ee5680d0f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:06.592014 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ae72612c-1700-4f15-aa3f-015ee5680d0f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:06.592676 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ae72612c-1700-4f15-aa3f-015ee5680d0f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:06.594242 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ae72612c-1700-4f15-aa3f-015ee5680d0f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:06.780434 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-faf0001c-1131-4903-9267-c469197f5f88 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Action: 'create', calling method: .version_select at 0x7f621ee87ee0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-106744613", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE3YlIQL2FOgElbGxGnBQtn/vKOJ/etmlOdhXTPshTN8GH3/V0IrqMRa/PNdt7aKzGA3dm6wfgHu7fXW0eh4NA2nHMRx375dwiMWhK/xkybllgahzCpdyF4wG2ghJO6Omw=="}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:38:06.799511 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-faf0001c-1131-4903-9267-c469197f5f88 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Getting quotas for project 267f4c2e27aa4f9db62c3877d948f3d9. Resources: {'key_pairs'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 30 19:38:06.803074 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-ae72612c-1700-4f15-aa3f-015ee5680d0f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:06.805828 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-faf0001c-1131-4903-9267-c469197f5f88 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Getting quotas for user eccbf92faf2b4bad8746a2a48f5a6226 and project 267f4c2e27aa4f9db62c3877d948f3d9. Resources: {'key_pairs'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 30 19:38:06.821821 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-ae72612c-1700-4f15-aa3f-015ee5680d0f tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191" status: 200 len: 1367 microversion: 2.1 time: 0.246843 Sep 30 19:38:06.822821 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 463/893] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:38:06 2022] GET /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191 => generated 1367 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:38:06.833787 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-faf0001c-1131-4903-9267-c469197f5f88 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.295131 Sep 30 19:38:06.835133 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 431/894] 10.222.0.17 () {60 vars in 1159 bytes} [Fri Sep 30 19:38:06 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:38:07.286411 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [req-1f02beab-0ad1-4f02-9004-d58ca1b888bf req-bf54c2d1-9328-4966-a5ca-bd550671dfc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42acb210-bef2-4e45-9b48-ed1c75fdf191", "tag": "84d6b83f-065d-42d4-ba43-89413a1e2ec8"}]} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:38:07.305600 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-1f02beab-0ad1-4f02-9004-d58ca1b888bf req-bf54c2d1-9328-4966-a5ca-bd550671dfc9 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:07.306111 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-1f02beab-0ad1-4f02-9004-d58ca1b888bf req-bf54c2d1-9328-4966-a5ca-bd550671dfc9 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:07.306545 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-1f02beab-0ad1-4f02-9004-d58ca1b888bf req-bf54c2d1-9328-4966-a5ca-bd550671dfc9 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:07.332076 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.compute.server_external_events [req-1f02beab-0ad1-4f02-9004-d58ca1b888bf req-bf54c2d1-9328-4966-a5ca-bd550671dfc9 service nova] Creating event network-changed:84d6b83f-065d-42d4-ba43-89413a1e2ec8 for instance 42acb210-bef2-4e45-9b48-ed1c75fdf191 on hv-cinder-86001 Sep 30 19:38:07.340941 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [req-1f02beab-0ad1-4f02-9004-d58ca1b888bf req-bf54c2d1-9328-4966-a5ca-bd550671dfc9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060232 Sep 30 19:38:07.342710 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 464/895] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:38:07.845935 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-b17e5b1c-cb38-448d-9709-9fc52b5d2634 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:07.846555 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-b17e5b1c-cb38-448d-9709-9fc52b5d2634 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: 42acb210-bef2-4e45-9b48-ed1c75fdf191] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:07.854196 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b17e5b1c-cb38-448d-9709-9fc52b5d2634 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:07.854859 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b17e5b1c-cb38-448d-9709-9fc52b5d2634 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:07.855433 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b17e5b1c-cb38-448d-9709-9fc52b5d2634 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:07.857079 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b17e5b1c-cb38-448d-9709-9fc52b5d2634 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:07.857661 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b17e5b1c-cb38-448d-9709-9fc52b5d2634 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:07.858712 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b17e5b1c-cb38-448d-9709-9fc52b5d2634 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:08.003134 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-b17e5b1c-cb38-448d-9709-9fc52b5d2634 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:08.011350 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-b17e5b1c-cb38-448d-9709-9fc52b5d2634 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191" status: 200 len: 1367 microversion: 2.1 time: 0.169512 Sep 30 19:38:08.020743 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 432/896] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:38:07 2022] GET /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:38:09.036257 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-69824574-a76b-4d73-89a9-cf21724024b3 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:09.037008 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-69824574-a76b-4d73-89a9-cf21724024b3 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: 42acb210-bef2-4e45-9b48-ed1c75fdf191] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:09.043229 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-69824574-a76b-4d73-89a9-cf21724024b3 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:09.043718 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-69824574-a76b-4d73-89a9-cf21724024b3 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:09.044155 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-69824574-a76b-4d73-89a9-cf21724024b3 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:09.044919 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-69824574-a76b-4d73-89a9-cf21724024b3 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:09.045748 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-69824574-a76b-4d73-89a9-cf21724024b3 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:09.046365 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-69824574-a76b-4d73-89a9-cf21724024b3 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:09.187530 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-69824574-a76b-4d73-89a9-cf21724024b3 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:09.218974 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-69824574-a76b-4d73-89a9-cf21724024b3 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191" status: 200 len: 1367 microversion: 2.1 time: 0.187700 Sep 30 19:38:09.220751 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 465/897] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:38:09 2022] GET /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191 => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:38:10.246689 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-6e6af9d9-172c-4157-b9e2-af403fa44e18 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:10.247303 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-6e6af9d9-172c-4157-b9e2-af403fa44e18 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: 42acb210-bef2-4e45-9b48-ed1c75fdf191] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:10.253768 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6e6af9d9-172c-4157-b9e2-af403fa44e18 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:10.254475 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6e6af9d9-172c-4157-b9e2-af403fa44e18 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:10.254917 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6e6af9d9-172c-4157-b9e2-af403fa44e18 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:10.255621 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6e6af9d9-172c-4157-b9e2-af403fa44e18 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:10.256076 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6e6af9d9-172c-4157-b9e2-af403fa44e18 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:10.257093 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6e6af9d9-172c-4157-b9e2-af403fa44e18 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:10.397043 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-6e6af9d9-172c-4157-b9e2-af403fa44e18 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:10.407952 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-6e6af9d9-172c-4157-b9e2-af403fa44e18 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191" status: 200 len: 1367 microversion: 2.1 time: 0.165046 Sep 30 19:38:10.408587 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 433/898] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:38:10 2022] GET /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:38:11.432172 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-7d35a729-c1d6-48f6-9fa0-425972fb50e9 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:11.432850 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-7d35a729-c1d6-48f6-9fa0-425972fb50e9 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: 42acb210-bef2-4e45-9b48-ed1c75fdf191] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:11.439264 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7d35a729-c1d6-48f6-9fa0-425972fb50e9 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:11.439747 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7d35a729-c1d6-48f6-9fa0-425972fb50e9 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:11.440183 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7d35a729-c1d6-48f6-9fa0-425972fb50e9 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:11.440932 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7d35a729-c1d6-48f6-9fa0-425972fb50e9 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:11.441411 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7d35a729-c1d6-48f6-9fa0-425972fb50e9 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:11.441814 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7d35a729-c1d6-48f6-9fa0-425972fb50e9 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:11.579780 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-7d35a729-c1d6-48f6-9fa0-425972fb50e9 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:11.587335 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-7d35a729-c1d6-48f6-9fa0-425972fb50e9 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191" status: 200 len: 1367 microversion: 2.1 time: 0.160060 Sep 30 19:38:11.588067 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 466/899] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:38:11 2022] GET /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:38:12.611220 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-905d1eb2-7498-484c-84fd-f99d4c9ee9c2 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:12.611927 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-905d1eb2-7498-484c-84fd-f99d4c9ee9c2 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: 42acb210-bef2-4e45-9b48-ed1c75fdf191] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:12.618883 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-905d1eb2-7498-484c-84fd-f99d4c9ee9c2 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:12.619375 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-905d1eb2-7498-484c-84fd-f99d4c9ee9c2 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:12.619811 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-905d1eb2-7498-484c-84fd-f99d4c9ee9c2 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:12.620556 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-905d1eb2-7498-484c-84fd-f99d4c9ee9c2 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:12.621010 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-905d1eb2-7498-484c-84fd-f99d4c9ee9c2 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:12.621433 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-905d1eb2-7498-484c-84fd-f99d4c9ee9c2 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:12.750985 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-905d1eb2-7498-484c-84fd-f99d4c9ee9c2 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:12.759250 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-905d1eb2-7498-484c-84fd-f99d4c9ee9c2 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191" status: 200 len: 1367 microversion: 2.1 time: 0.151964 Sep 30 19:38:12.759829 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 434/900] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:38:12 2022] GET /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:38:13.782260 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-ac9deb96-2126-4a1e-96a2-8e0c4d909e99 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:13.782903 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-ac9deb96-2126-4a1e-96a2-8e0c4d909e99 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: 42acb210-bef2-4e45-9b48-ed1c75fdf191] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:13.785668 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell0:SELECT=6 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:38:13.790987 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ac9deb96-2126-4a1e-96a2-8e0c4d909e99 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:13.791471 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ac9deb96-2126-4a1e-96a2-8e0c4d909e99 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:13.791907 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ac9deb96-2126-4a1e-96a2-8e0c4d909e99 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:13.792628 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ac9deb96-2126-4a1e-96a2-8e0c4d909e99 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:13.793084 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ac9deb96-2126-4a1e-96a2-8e0c4d909e99 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:13.793508 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ac9deb96-2126-4a1e-96a2-8e0c4d909e99 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:13.922800 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-ac9deb96-2126-4a1e-96a2-8e0c4d909e99 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:13.931008 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-ac9deb96-2126-4a1e-96a2-8e0c4d909e99 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191" status: 200 len: 1367 microversion: 2.1 time: 0.152737 Sep 30 19:38:13.931565 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 467/901] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:38:13 2022] GET /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:38:14.207598 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-876c05c5-38b4-4eb6-9b9e-db8825ba2108 req-6f8e3f28-5329-4585-b068-c50b786067cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42acb210-bef2-4e45-9b48-ed1c75fdf191", "name": "network-vif-plugged", "status": "completed", "tag": "84d6b83f-065d-42d4-ba43-89413a1e2ec8"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:38:14.213364 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=2 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:38:14.220653 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-876c05c5-38b4-4eb6-9b9e-db8825ba2108 req-6f8e3f28-5329-4585-b068-c50b786067cd service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:14.221131 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-876c05c5-38b4-4eb6-9b9e-db8825ba2108 req-6f8e3f28-5329-4585-b068-c50b786067cd service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:14.221607 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-876c05c5-38b4-4eb6-9b9e-db8825ba2108 req-6f8e3f28-5329-4585-b068-c50b786067cd service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:14.233635 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-876c05c5-38b4-4eb6-9b9e-db8825ba2108 req-6f8e3f28-5329-4585-b068-c50b786067cd service nova] Creating event network-vif-plugged:84d6b83f-065d-42d4-ba43-89413a1e2ec8 for instance 42acb210-bef2-4e45-9b48-ed1c75fdf191 on hv-cinder-86001 Sep 30 19:38:14.238563 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-876c05c5-38b4-4eb6-9b9e-db8825ba2108 req-6f8e3f28-5329-4585-b068-c50b786067cd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034666 Sep 30 19:38:14.239152 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 435/902] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:38:14.953566 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-4c958f3e-6b19-4bad-8e52-023ef9e9d1e5 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:14.954234 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-4c958f3e-6b19-4bad-8e52-023ef9e9d1e5 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: 42acb210-bef2-4e45-9b48-ed1c75fdf191] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:14.961249 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4c958f3e-6b19-4bad-8e52-023ef9e9d1e5 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:14.961723 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4c958f3e-6b19-4bad-8e52-023ef9e9d1e5 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:14.962158 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4c958f3e-6b19-4bad-8e52-023ef9e9d1e5 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:14.962849 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4c958f3e-6b19-4bad-8e52-023ef9e9d1e5 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:14.963298 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4c958f3e-6b19-4bad-8e52-023ef9e9d1e5 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:14.963721 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4c958f3e-6b19-4bad-8e52-023ef9e9d1e5 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:15.098763 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-4c958f3e-6b19-4bad-8e52-023ef9e9d1e5 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:15.106560 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-4c958f3e-6b19-4bad-8e52-023ef9e9d1e5 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191" status: 200 len: 1367 microversion: 2.1 time: 0.157022 Sep 30 19:38:15.107119 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 468/903] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:38:14 2022] GET /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:38:16.132234 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-6e58e389-501d-411f-94bf-ada8c0e7cb67 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:16.133964 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-6e58e389-501d-411f-94bf-ada8c0e7cb67 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: 42acb210-bef2-4e45-9b48-ed1c75fdf191] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:16.140352 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6e58e389-501d-411f-94bf-ada8c0e7cb67 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:16.140831 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6e58e389-501d-411f-94bf-ada8c0e7cb67 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:16.141278 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6e58e389-501d-411f-94bf-ada8c0e7cb67 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:16.142201 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6e58e389-501d-411f-94bf-ada8c0e7cb67 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:16.142736 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6e58e389-501d-411f-94bf-ada8c0e7cb67 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:16.143398 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6e58e389-501d-411f-94bf-ada8c0e7cb67 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:16.276888 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-6e58e389-501d-411f-94bf-ada8c0e7cb67 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:16.284505 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-6e58e389-501d-411f-94bf-ada8c0e7cb67 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191" status: 200 len: 1367 microversion: 2.1 time: 0.157804 Sep 30 19:38:16.285328 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 436/904] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:38:16 2022] GET /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:38:17.307191 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-2381dec2-ccec-43f3-8e26-e0b857faf5e2 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:17.308471 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-2381dec2-ccec-43f3-8e26-e0b857faf5e2 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: 42acb210-bef2-4e45-9b48-ed1c75fdf191] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:17.315513 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2381dec2-ccec-43f3-8e26-e0b857faf5e2 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:17.316013 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2381dec2-ccec-43f3-8e26-e0b857faf5e2 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:17.316551 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2381dec2-ccec-43f3-8e26-e0b857faf5e2 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:17.317273 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2381dec2-ccec-43f3-8e26-e0b857faf5e2 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:17.317729 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2381dec2-ccec-43f3-8e26-e0b857faf5e2 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:17.318154 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2381dec2-ccec-43f3-8e26-e0b857faf5e2 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:17.448971 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-2381dec2-ccec-43f3-8e26-e0b857faf5e2 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:17.457329 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-2381dec2-ccec-43f3-8e26-e0b857faf5e2 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191" status: 200 len: 1557 microversion: 2.1 time: 0.154004 Sep 30 19:38:17.457913 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 469/905] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:38:17 2022] GET /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191 => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:38:17.479449 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-85c66c0f-ca98-43ea-939b-4b160ed325f6 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:17.479945 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-85c66c0f-ca98-43ea-939b-4b160ed325f6 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: 42acb210-bef2-4e45-9b48-ed1c75fdf191] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:17.481951 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=10 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:38:17.483194 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:38:17.489159 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-85c66c0f-ca98-43ea-939b-4b160ed325f6 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:17.489645 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-85c66c0f-ca98-43ea-939b-4b160ed325f6 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:17.490080 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-85c66c0f-ca98-43ea-939b-4b160ed325f6 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:17.490778 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-85c66c0f-ca98-43ea-939b-4b160ed325f6 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:17.491226 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-85c66c0f-ca98-43ea-939b-4b160ed325f6 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:17.491650 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-85c66c0f-ca98-43ea-939b-4b160ed325f6 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:17.575890 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-85c66c0f-ca98-43ea-939b-4b160ed325f6 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100207 Sep 30 19:38:17.576489 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 437/906] 10.222.0.17 () {58 vars in 1275 bytes} [Fri Sep 30 19:38:17 2022] GET /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:38:18.525626 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [req-89afe2e6-905f-4e8d-a964-e73d27c64120 req-aaed590a-7d4d-4892-89f6-2496f9a9b47b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42acb210-bef2-4e45-9b48-ed1c75fdf191", "tag": "84d6b83f-065d-42d4-ba43-89413a1e2ec8"}]} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:38:18.537407 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-89afe2e6-905f-4e8d-a964-e73d27c64120 req-aaed590a-7d4d-4892-89f6-2496f9a9b47b service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:18.538030 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-89afe2e6-905f-4e8d-a964-e73d27c64120 req-aaed590a-7d4d-4892-89f6-2496f9a9b47b service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:18.538500 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-89afe2e6-905f-4e8d-a964-e73d27c64120 req-aaed590a-7d4d-4892-89f6-2496f9a9b47b service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:18.549746 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.compute.server_external_events [req-89afe2e6-905f-4e8d-a964-e73d27c64120 req-aaed590a-7d4d-4892-89f6-2496f9a9b47b service nova] Creating event network-changed:84d6b83f-065d-42d4-ba43-89413a1e2ec8 for instance 42acb210-bef2-4e45-9b48-ed1c75fdf191 on hv-cinder-86001 Sep 30 19:38:18.554856 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [req-89afe2e6-905f-4e8d-a964-e73d27c64120 req-aaed590a-7d4d-4892-89f6-2496f9a9b47b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032887 Sep 30 19:38:18.555614 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 470/907] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:38:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:38:18.895843 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-a5db94bd-6e38-4257-a9a0-1174f404d6ba tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:18.896429 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-a5db94bd-6e38-4257-a9a0-1174f404d6ba tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:18.903051 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a5db94bd-6e38-4257-a9a0-1174f404d6ba tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:18.904023 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a5db94bd-6e38-4257-a9a0-1174f404d6ba tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:18.904570 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a5db94bd-6e38-4257-a9a0-1174f404d6ba tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:18.905333 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a5db94bd-6e38-4257-a9a0-1174f404d6ba tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:18.905826 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a5db94bd-6e38-4257-a9a0-1174f404d6ba tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:18.906448 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a5db94bd-6e38-4257-a9a0-1174f404d6ba tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:18.931389 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-a5db94bd-6e38-4257-a9a0-1174f404d6ba tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700/ips" status: 200 len: 150 microversion: 2.20 time: 0.040268 Sep 30 19:38:18.932307 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 438/908] 10.222.0.17 () {60 vars in 1289 bytes} [Fri Sep 30 19:38:18 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 30 19:38:20.807450 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-d8daf773-12af-4b52-b899-89e25549c731 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:38:20.808076 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-d8daf773-12af-4b52-b899-89e25549c731 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:20.814882 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d8daf773-12af-4b52-b899-89e25549c731 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:20.815367 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d8daf773-12af-4b52-b899-89e25549c731 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:20.815806 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d8daf773-12af-4b52-b899-89e25549c731 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:20.816552 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d8daf773-12af-4b52-b899-89e25549c731 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:20.817033 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d8daf773-12af-4b52-b899-89e25549c731 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:20.817508 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d8daf773-12af-4b52-b899-89e25549c731 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:20.839204 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.objects.instance [None req-d8daf773-12af-4b52-b899-89e25549c731 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lazy-loading 'flavor' on Instance uuid 67a09687-3d87-4069-b17c-6ed9b6e96700 {{(pid=120649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 30 19:38:21.022260 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-d8daf773-12af-4b52-b899-89e25549c731 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "POST /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700/action" status: 202 len: 0 microversion: 2.20 time: 0.219363 Sep 30 19:38:21.023031 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 471/909] 10.222.0.17 () {62 vars in 1319 bytes} [Fri Sep 30 19:38:20 2022] POST /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 30 19:38:21.032021 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-4434fbc8-144e-4ecc-a584-2c017cbafacc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:21.033222 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-4434fbc8-144e-4ecc-a584-2c017cbafacc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:21.040315 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4434fbc8-144e-4ecc-a584-2c017cbafacc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:21.040891 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4434fbc8-144e-4ecc-a584-2c017cbafacc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:21.041266 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4434fbc8-144e-4ecc-a584-2c017cbafacc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:21.041967 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4434fbc8-144e-4ecc-a584-2c017cbafacc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:21.042458 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4434fbc8-144e-4ecc-a584-2c017cbafacc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:21.042848 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4434fbc8-144e-4ecc-a584-2c017cbafacc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:21.173895 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-4434fbc8-144e-4ecc-a584-2c017cbafacc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:21.182057 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-4434fbc8-144e-4ecc-a584-2c017cbafacc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:21.183486 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-4434fbc8-144e-4ecc-a584-2c017cbafacc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:21.184700 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-4434fbc8-144e-4ecc-a584-2c017cbafacc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1720 microversion: 2.20 time: 0.157214 Sep 30 19:38:21.185244 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 439/910] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:38:21 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:38:22.210470 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-99c2525a-dbec-4bc2-8b4c-14894a0b89fc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:22.211202 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-99c2525a-dbec-4bc2-8b4c-14894a0b89fc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:22.217454 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-99c2525a-dbec-4bc2-8b4c-14894a0b89fc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:22.217944 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-99c2525a-dbec-4bc2-8b4c-14894a0b89fc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:22.218416 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-99c2525a-dbec-4bc2-8b4c-14894a0b89fc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:22.219112 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-99c2525a-dbec-4bc2-8b4c-14894a0b89fc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:22.219572 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-99c2525a-dbec-4bc2-8b4c-14894a0b89fc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:22.220004 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-99c2525a-dbec-4bc2-8b4c-14894a0b89fc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:22.349301 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-99c2525a-dbec-4bc2-8b4c-14894a0b89fc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:22.357784 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-99c2525a-dbec-4bc2-8b4c-14894a0b89fc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:22.359228 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-99c2525a-dbec-4bc2-8b4c-14894a0b89fc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:22.360405 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-99c2525a-dbec-4bc2-8b4c-14894a0b89fc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1720 microversion: 2.20 time: 0.154710 Sep 30 19:38:22.360962 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 472/911] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:38:22 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:38:23.385514 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-de5bee53-6769-486f-a577-811e2c9e46cc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:23.386124 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-de5bee53-6769-486f-a577-811e2c9e46cc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:23.393610 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-de5bee53-6769-486f-a577-811e2c9e46cc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:23.394101 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-de5bee53-6769-486f-a577-811e2c9e46cc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:23.394541 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-de5bee53-6769-486f-a577-811e2c9e46cc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:23.395241 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-de5bee53-6769-486f-a577-811e2c9e46cc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:23.395707 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-de5bee53-6769-486f-a577-811e2c9e46cc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:23.396137 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-de5bee53-6769-486f-a577-811e2c9e46cc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:23.525620 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-de5bee53-6769-486f-a577-811e2c9e46cc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:23.533975 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-de5bee53-6769-486f-a577-811e2c9e46cc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:23.535683 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-de5bee53-6769-486f-a577-811e2c9e46cc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:23.536891 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-de5bee53-6769-486f-a577-811e2c9e46cc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1720 microversion: 2.20 time: 0.155301 Sep 30 19:38:23.537430 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 440/912] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:38:23 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:38:24.562802 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-c0eeaa9b-8336-4c26-a6f4-fe08cc6be81d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:24.563414 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-c0eeaa9b-8336-4c26-a6f4-fe08cc6be81d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:24.569566 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c0eeaa9b-8336-4c26-a6f4-fe08cc6be81d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:24.570057 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c0eeaa9b-8336-4c26-a6f4-fe08cc6be81d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:24.570497 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c0eeaa9b-8336-4c26-a6f4-fe08cc6be81d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:24.571193 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c0eeaa9b-8336-4c26-a6f4-fe08cc6be81d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:24.571651 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c0eeaa9b-8336-4c26-a6f4-fe08cc6be81d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:24.572080 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c0eeaa9b-8336-4c26-a6f4-fe08cc6be81d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:24.701619 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-c0eeaa9b-8336-4c26-a6f4-fe08cc6be81d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:24.709623 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-c0eeaa9b-8336-4c26-a6f4-fe08cc6be81d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:24.711132 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-c0eeaa9b-8336-4c26-a6f4-fe08cc6be81d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:24.712296 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-c0eeaa9b-8336-4c26-a6f4-fe08cc6be81d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1720 microversion: 2.20 time: 0.153438 Sep 30 19:38:24.712887 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 473/913] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:38:24 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:38:25.738183 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-ba20c26d-049c-4c1d-be7a-cefb9fbbfdeb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:25.738792 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-ba20c26d-049c-4c1d-be7a-cefb9fbbfdeb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:25.745219 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ba20c26d-049c-4c1d-be7a-cefb9fbbfdeb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:25.745704 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ba20c26d-049c-4c1d-be7a-cefb9fbbfdeb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:25.746141 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ba20c26d-049c-4c1d-be7a-cefb9fbbfdeb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:25.746825 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ba20c26d-049c-4c1d-be7a-cefb9fbbfdeb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:25.747294 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ba20c26d-049c-4c1d-be7a-cefb9fbbfdeb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:25.747699 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ba20c26d-049c-4c1d-be7a-cefb9fbbfdeb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:25.870389 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-ba20c26d-049c-4c1d-be7a-cefb9fbbfdeb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:25.878349 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-ba20c26d-049c-4c1d-be7a-cefb9fbbfdeb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:25.879783 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-ba20c26d-049c-4c1d-be7a-cefb9fbbfdeb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:25.880971 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-ba20c26d-049c-4c1d-be7a-cefb9fbbfdeb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1720 microversion: 2.20 time: 0.146758 Sep 30 19:38:25.881527 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 441/914] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:38:25 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1720 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:38:26.907284 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-748abbaf-ab4c-410a-9394-7906063cfcb3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:26.907806 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-748abbaf-ab4c-410a-9394-7906063cfcb3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:26.915146 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-748abbaf-ab4c-410a-9394-7906063cfcb3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:26.915652 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-748abbaf-ab4c-410a-9394-7906063cfcb3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:26.916094 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-748abbaf-ab4c-410a-9394-7906063cfcb3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:26.916828 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-748abbaf-ab4c-410a-9394-7906063cfcb3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:26.917289 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-748abbaf-ab4c-410a-9394-7906063cfcb3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:26.917721 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-748abbaf-ab4c-410a-9394-7906063cfcb3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:27.046964 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-748abbaf-ab4c-410a-9394-7906063cfcb3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:27.054973 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-748abbaf-ab4c-410a-9394-7906063cfcb3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:27.056440 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-748abbaf-ab4c-410a-9394-7906063cfcb3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:27.057595 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-748abbaf-ab4c-410a-9394-7906063cfcb3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1720 microversion: 2.20 time: 0.154838 Sep 30 19:38:27.058154 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 474/915] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:38:26 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:38:28.082457 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-fd1ab48b-df30-4cfe-923e-45a6cdcd289f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:28.083025 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-fd1ab48b-df30-4cfe-923e-45a6cdcd289f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:28.089508 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fd1ab48b-df30-4cfe-923e-45a6cdcd289f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:28.089990 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fd1ab48b-df30-4cfe-923e-45a6cdcd289f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:28.090427 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fd1ab48b-df30-4cfe-923e-45a6cdcd289f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:28.091121 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fd1ab48b-df30-4cfe-923e-45a6cdcd289f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:28.091575 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fd1ab48b-df30-4cfe-923e-45a6cdcd289f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:28.091998 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fd1ab48b-df30-4cfe-923e-45a6cdcd289f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:28.215297 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-fd1ab48b-df30-4cfe-923e-45a6cdcd289f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:28.223296 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-fd1ab48b-df30-4cfe-923e-45a6cdcd289f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:28.224865 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-fd1ab48b-df30-4cfe-923e-45a6cdcd289f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:28.226022 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-fd1ab48b-df30-4cfe-923e-45a6cdcd289f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1720 microversion: 2.20 time: 0.147575 Sep 30 19:38:28.226575 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 442/916] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:38:28 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1720 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:38:29.251703 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-08bd55fa-349e-41cd-9594-9420d461316d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:29.252317 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-08bd55fa-349e-41cd-9594-9420d461316d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:29.259157 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-08bd55fa-349e-41cd-9594-9420d461316d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:29.259645 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-08bd55fa-349e-41cd-9594-9420d461316d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:29.260087 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-08bd55fa-349e-41cd-9594-9420d461316d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:29.260824 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-08bd55fa-349e-41cd-9594-9420d461316d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:29.261284 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-08bd55fa-349e-41cd-9594-9420d461316d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:29.261713 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-08bd55fa-349e-41cd-9594-9420d461316d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:29.398371 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-08bd55fa-349e-41cd-9594-9420d461316d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:29.406893 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-08bd55fa-349e-41cd-9594-9420d461316d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:29.408339 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-08bd55fa-349e-41cd-9594-9420d461316d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:29.409508 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-08bd55fa-349e-41cd-9594-9420d461316d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1720 microversion: 2.20 time: 0.161705 Sep 30 19:38:29.410325 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 475/917] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:38:29 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:38:30.435070 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-9dd138d7-38c5-4510-9da2-3ec9460f0d71 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:30.435678 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-9dd138d7-38c5-4510-9da2-3ec9460f0d71 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:30.442043 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9dd138d7-38c5-4510-9da2-3ec9460f0d71 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:30.442524 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9dd138d7-38c5-4510-9da2-3ec9460f0d71 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:30.442959 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9dd138d7-38c5-4510-9da2-3ec9460f0d71 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:30.443648 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9dd138d7-38c5-4510-9da2-3ec9460f0d71 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:30.444101 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9dd138d7-38c5-4510-9da2-3ec9460f0d71 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:30.444555 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9dd138d7-38c5-4510-9da2-3ec9460f0d71 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:30.576592 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-9dd138d7-38c5-4510-9da2-3ec9460f0d71 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:30.584621 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-9dd138d7-38c5-4510-9da2-3ec9460f0d71 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:30.586065 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-9dd138d7-38c5-4510-9da2-3ec9460f0d71 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:30.587231 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-9dd138d7-38c5-4510-9da2-3ec9460f0d71 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1720 microversion: 2.20 time: 0.156107 Sep 30 19:38:30.587780 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 443/918] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:38:30 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:38:31.613351 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-4826f3b2-aa2b-4461-9b9a-0a10e984838d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:31.613959 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-4826f3b2-aa2b-4461-9b9a-0a10e984838d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:31.620257 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4826f3b2-aa2b-4461-9b9a-0a10e984838d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:31.620767 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4826f3b2-aa2b-4461-9b9a-0a10e984838d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:31.621202 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4826f3b2-aa2b-4461-9b9a-0a10e984838d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:31.621926 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4826f3b2-aa2b-4461-9b9a-0a10e984838d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:31.622377 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4826f3b2-aa2b-4461-9b9a-0a10e984838d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:31.622802 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4826f3b2-aa2b-4461-9b9a-0a10e984838d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:31.747556 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-4826f3b2-aa2b-4461-9b9a-0a10e984838d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:31.755404 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-4826f3b2-aa2b-4461-9b9a-0a10e984838d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:31.756850 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-4826f3b2-aa2b-4461-9b9a-0a10e984838d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:31.757997 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-4826f3b2-aa2b-4461-9b9a-0a10e984838d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1720 microversion: 2.20 time: 0.148529 Sep 30 19:38:31.758540 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 476/919] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:38:31 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1720 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:38:32.071265 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-ad7196ee-917c-42c8-af1e-ef34018d92c7 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1774896789", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-106744613", "security_groups": [{"name": "tempest-secgroup-smoke-1336083125"}], "block_device_mapping_v2": [{"uuid": "1ff97668-22a8-44ed-8122-0ffbc6f60320", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5eacc127-b1a0-451d-80fc-349e698deff5"}]}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:38:32.183517 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.network.neutron [None req-ad7196ee-917c-42c8-af1e-ef34018d92c7 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] validate_networks() for [('5eacc127-b1a0-451d-80fc-349e698deff5', None, None, None, None, None)] {{(pid=120648) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 30 19:38:32.549357 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-ad7196ee-917c-42c8-af1e-ef34018d92c7 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Flavor limits 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 30 19:38:32.549784 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-ad7196ee-917c-42c8-af1e-ef34018d92c7 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Image limits 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 30 19:38:32.550258 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-ad7196ee-917c-42c8-af1e-ef34018d92c7 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Flavor pref 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 30 19:38:32.550668 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-ad7196ee-917c-42c8-af1e-ef34018d92c7 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Image pref 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 30 19:38:32.551079 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-ad7196ee-917c-42c8-af1e-ef34018d92c7 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 30 19:38:32.559960 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ad7196ee-917c-42c8-af1e-ef34018d92c7 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:32.560474 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ad7196ee-917c-42c8-af1e-ef34018d92c7 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:32.560912 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ad7196ee-917c-42c8-af1e-ef34018d92c7 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:32.561641 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ad7196ee-917c-42c8-af1e-ef34018d92c7 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:32.562098 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ad7196ee-917c-42c8-af1e-ef34018d92c7 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:32.562525 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ad7196ee-917c-42c8-af1e-ef34018d92c7 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:32.579414 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-ad7196ee-917c-42c8-af1e-ef34018d92c7 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Getting quotas for project 267f4c2e27aa4f9db62c3877d948f3d9. Resources: {'instances', 'ram', 'cores'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 30 19:38:32.583356 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-ad7196ee-917c-42c8-af1e-ef34018d92c7 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Getting quotas for user eccbf92faf2b4bad8746a2a48f5a6226 and project 267f4c2e27aa4f9db62c3877d948f3d9. Resources: {'instances', 'ram', 'cores'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 30 19:38:32.639099 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-ad7196ee-917c-42c8-af1e-ef34018d92c7 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Going to run 1 instances... {{(pid=120648) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 30 19:38:32.641279 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-ad7196ee-917c-42c8-af1e-ef34018d92c7 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: 9a0cc547-90fa-43de-b4f6-b1653194be5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1ff97668-22a8-44ed-8122-0ffbc6f60320',volume_size=None,volume_type=None)] {{(pid=120648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 30 19:38:32.767749 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-ad7196ee-917c-42c8-af1e-ef34018d92c7 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.700233 Sep 30 19:38:32.768416 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 444/920] 10.222.0.17 () {60 vars in 1147 bytes} [Fri Sep 30 19:38:32 2022] POST /compute/v2.1/servers => generated 406 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 30 19:38:32.781688 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-4f116083-fdd2-4d72-8aa0-0c94ebdb50db tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:32.782308 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-4f116083-fdd2-4d72-8aa0-0c94ebdb50db tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: 9a0cc547-90fa-43de-b4f6-b1653194be5e] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:32.785578 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-fcac15a5-190b-4817-a369-8732cf53fa1d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:32.786221 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-fcac15a5-190b-4817-a369-8732cf53fa1d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:32.793833 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fcac15a5-190b-4817-a369-8732cf53fa1d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:32.794313 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fcac15a5-190b-4817-a369-8732cf53fa1d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:32.794901 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fcac15a5-190b-4817-a369-8732cf53fa1d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:32.795599 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fcac15a5-190b-4817-a369-8732cf53fa1d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:32.796050 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fcac15a5-190b-4817-a369-8732cf53fa1d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:32.796499 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fcac15a5-190b-4817-a369-8732cf53fa1d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:32.841679 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-4f116083-fdd2-4d72-8aa0-0c94ebdb50db tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:32.848497 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-4f116083-fdd2-4d72-8aa0-0c94ebdb50db tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e" status: 200 len: 1094 microversion: 2.1 time: 0.072908 Sep 30 19:38:32.849260 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 477/921] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:38:32 2022] GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:38:32.937792 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-fcac15a5-190b-4817-a369-8732cf53fa1d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:32.945926 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-fcac15a5-190b-4817-a369-8732cf53fa1d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:32.947536 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-fcac15a5-190b-4817-a369-8732cf53fa1d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:32.948760 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-fcac15a5-190b-4817-a369-8732cf53fa1d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1720 microversion: 2.20 time: 0.168500 Sep 30 19:38:32.949508 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 445/922] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:38:32 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1720 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:38:33.871082 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-a894349f-843b-4a1c-99ed-fb0c25c75709 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:33.871892 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-a894349f-843b-4a1c-99ed-fb0c25c75709 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: 9a0cc547-90fa-43de-b4f6-b1653194be5e] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:33.874417 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_api:SELECT=38 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:38:33.880680 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a894349f-843b-4a1c-99ed-fb0c25c75709 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:33.881177 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a894349f-843b-4a1c-99ed-fb0c25c75709 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:33.881622 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a894349f-843b-4a1c-99ed-fb0c25c75709 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:33.882330 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a894349f-843b-4a1c-99ed-fb0c25c75709 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:33.882793 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a894349f-843b-4a1c-99ed-fb0c25c75709 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:33.883253 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a894349f-843b-4a1c-99ed-fb0c25c75709 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:33.946322 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-a894349f-843b-4a1c-99ed-fb0c25c75709 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:33.954164 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-a894349f-843b-4a1c-99ed-fb0c25c75709 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e" status: 200 len: 1200 microversion: 2.1 time: 0.086918 Sep 30 19:38:33.954952 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 478/923] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:38:33 2022] GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e => generated 1200 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:38:33.975281 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-45690bb5-e6a5-4b71-b585-edd428b24ec2 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:33.976118 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-45690bb5-e6a5-4b71-b585-edd428b24ec2 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:33.983802 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-45690bb5-e6a5-4b71-b585-edd428b24ec2 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:33.984337 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-45690bb5-e6a5-4b71-b585-edd428b24ec2 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:33.984828 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-45690bb5-e6a5-4b71-b585-edd428b24ec2 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:33.985609 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-45690bb5-e6a5-4b71-b585-edd428b24ec2 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:33.986153 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-45690bb5-e6a5-4b71-b585-edd428b24ec2 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:33.986770 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-45690bb5-e6a5-4b71-b585-edd428b24ec2 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:33.989971 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=80 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:38:34.127746 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-45690bb5-e6a5-4b71-b585-edd428b24ec2 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:34.136107 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-45690bb5-e6a5-4b71-b585-edd428b24ec2 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:34.138257 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-45690bb5-e6a5-4b71-b585-edd428b24ec2 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:34.139459 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-45690bb5-e6a5-4b71-b585-edd428b24ec2 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1720 microversion: 2.20 time: 0.168347 Sep 30 19:38:34.140015 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 446/924] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:38:33 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1720 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:38:34.977919 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-13fcf8d1-cd45-405b-a145-7e6e73374845 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:34.978565 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-13fcf8d1-cd45-405b-a145-7e6e73374845 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: 9a0cc547-90fa-43de-b4f6-b1653194be5e] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:34.985418 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-13fcf8d1-cd45-405b-a145-7e6e73374845 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:34.985899 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-13fcf8d1-cd45-405b-a145-7e6e73374845 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:34.986337 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-13fcf8d1-cd45-405b-a145-7e6e73374845 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:34.987033 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-13fcf8d1-cd45-405b-a145-7e6e73374845 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:34.987491 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-13fcf8d1-cd45-405b-a145-7e6e73374845 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:34.987920 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-13fcf8d1-cd45-405b-a145-7e6e73374845 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:34.990460 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:38:35.166158 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-3d185c8e-ee50-498f-a759-49c40fd1e11d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:35.166768 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-3d185c8e-ee50-498f-a759-49c40fd1e11d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:35.174029 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3d185c8e-ee50-498f-a759-49c40fd1e11d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:35.174434 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3d185c8e-ee50-498f-a759-49c40fd1e11d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:35.174867 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3d185c8e-ee50-498f-a759-49c40fd1e11d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:35.175575 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3d185c8e-ee50-498f-a759-49c40fd1e11d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:35.176055 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3d185c8e-ee50-498f-a759-49c40fd1e11d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:35.176505 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3d185c8e-ee50-498f-a759-49c40fd1e11d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:35.311618 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-3d185c8e-ee50-498f-a759-49c40fd1e11d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:35.319890 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-3d185c8e-ee50-498f-a759-49c40fd1e11d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:35.321369 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-3d185c8e-ee50-498f-a759-49c40fd1e11d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:35.322548 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-3d185c8e-ee50-498f-a759-49c40fd1e11d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1720 microversion: 2.20 time: 0.160328 Sep 30 19:38:35.323112 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 447/925] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:38:35 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:38:35.421659 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-13fcf8d1-cd45-405b-a145-7e6e73374845 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:35.429932 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-13fcf8d1-cd45-405b-a145-7e6e73374845 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e" status: 200 len: 1266 microversion: 2.1 time: 0.455910 Sep 30 19:38:35.430625 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 479/926] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:38:34 2022] GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e => generated 1266 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:38:35.731414 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-1c99787e-3d89-4c0f-bbb3-e9875e8b9ab5 req-92c150d5-df34-43ca-8738-334ce074e9b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a0cc547-90fa-43de-b4f6-b1653194be5e", "tag": "c7257cd3-8682-4d80-8650-53ef46de5429"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:38:35.740777 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-1c99787e-3d89-4c0f-bbb3-e9875e8b9ab5 req-92c150d5-df34-43ca-8738-334ce074e9b6 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:35.741248 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-1c99787e-3d89-4c0f-bbb3-e9875e8b9ab5 req-92c150d5-df34-43ca-8738-334ce074e9b6 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:35.741669 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-1c99787e-3d89-4c0f-bbb3-e9875e8b9ab5 req-92c150d5-df34-43ca-8738-334ce074e9b6 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:35.752162 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-1c99787e-3d89-4c0f-bbb3-e9875e8b9ab5 req-92c150d5-df34-43ca-8738-334ce074e9b6 service nova] Creating event network-changed:c7257cd3-8682-4d80-8650-53ef46de5429 for instance 9a0cc547-90fa-43de-b4f6-b1653194be5e on hv-cinder-86001 Sep 30 19:38:35.757028 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-1c99787e-3d89-4c0f-bbb3-e9875e8b9ab5 req-92c150d5-df34-43ca-8738-334ce074e9b6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029526 Sep 30 19:38:35.757663 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 448/927] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:38:36.349186 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-db681e95-1cf5-42b5-bbd0-2aba075c6de8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:36.349799 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-db681e95-1cf5-42b5-bbd0-2aba075c6de8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:36.356577 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-db681e95-1cf5-42b5-bbd0-2aba075c6de8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:36.357059 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-db681e95-1cf5-42b5-bbd0-2aba075c6de8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:36.357497 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-db681e95-1cf5-42b5-bbd0-2aba075c6de8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:36.358217 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-db681e95-1cf5-42b5-bbd0-2aba075c6de8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:36.358669 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-db681e95-1cf5-42b5-bbd0-2aba075c6de8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:36.359093 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-db681e95-1cf5-42b5-bbd0-2aba075c6de8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:36.454528 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-6d783b50-2b58-4313-979c-f15664857f91 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:36.455227 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-6d783b50-2b58-4313-979c-f15664857f91 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: 9a0cc547-90fa-43de-b4f6-b1653194be5e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:36.461289 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6d783b50-2b58-4313-979c-f15664857f91 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:36.461771 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6d783b50-2b58-4313-979c-f15664857f91 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:36.462205 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6d783b50-2b58-4313-979c-f15664857f91 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:36.462895 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6d783b50-2b58-4313-979c-f15664857f91 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:36.463374 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6d783b50-2b58-4313-979c-f15664857f91 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:36.463797 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6d783b50-2b58-4313-979c-f15664857f91 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:36.489863 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-db681e95-1cf5-42b5-bbd0-2aba075c6de8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:36.498675 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-db681e95-1cf5-42b5-bbd0-2aba075c6de8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:36.500124 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-db681e95-1cf5-42b5-bbd0-2aba075c6de8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:36.501318 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-db681e95-1cf5-42b5-bbd0-2aba075c6de8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1720 microversion: 2.20 time: 0.156125 Sep 30 19:38:36.501892 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 480/928] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:38:36 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:38:36.596022 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-6d783b50-2b58-4313-979c-f15664857f91 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:36.604556 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-6d783b50-2b58-4313-979c-f15664857f91 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e" status: 200 len: 1266 microversion: 2.1 time: 0.154719 Sep 30 19:38:36.605064 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 449/929] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:38:36 2022] GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:38:37.526650 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-6c6b04ea-a4d2-4a01-81d9-2399f3994420 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:37.527387 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-6c6b04ea-a4d2-4a01-81d9-2399f3994420 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:37.533857 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6c6b04ea-a4d2-4a01-81d9-2399f3994420 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:37.534348 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6c6b04ea-a4d2-4a01-81d9-2399f3994420 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:37.535058 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6c6b04ea-a4d2-4a01-81d9-2399f3994420 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:37.535745 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6c6b04ea-a4d2-4a01-81d9-2399f3994420 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:37.536208 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6c6b04ea-a4d2-4a01-81d9-2399f3994420 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:37.536662 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6c6b04ea-a4d2-4a01-81d9-2399f3994420 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:37.628713 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-a8c41f00-acda-42c7-9d25-ca215fec20d4 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:37.629349 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-a8c41f00-acda-42c7-9d25-ca215fec20d4 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: 9a0cc547-90fa-43de-b4f6-b1653194be5e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:37.635818 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a8c41f00-acda-42c7-9d25-ca215fec20d4 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:37.636297 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a8c41f00-acda-42c7-9d25-ca215fec20d4 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:37.636753 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a8c41f00-acda-42c7-9d25-ca215fec20d4 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:37.638061 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a8c41f00-acda-42c7-9d25-ca215fec20d4 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:37.638510 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a8c41f00-acda-42c7-9d25-ca215fec20d4 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:37.638927 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a8c41f00-acda-42c7-9d25-ca215fec20d4 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:37.758551 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-6c6b04ea-a4d2-4a01-81d9-2399f3994420 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:37.767575 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-6c6b04ea-a4d2-4a01-81d9-2399f3994420 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:37.769130 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-6c6b04ea-a4d2-4a01-81d9-2399f3994420 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:37.770313 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-6c6b04ea-a4d2-4a01-81d9-2399f3994420 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1720 microversion: 2.20 time: 0.247644 Sep 30 19:38:37.770873 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 481/930] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:38:37 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1720 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:38:37.774378 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-a8c41f00-acda-42c7-9d25-ca215fec20d4 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:37.782236 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-a8c41f00-acda-42c7-9d25-ca215fec20d4 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e" status: 200 len: 1266 microversion: 2.1 time: 0.157406 Sep 30 19:38:37.782809 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 450/931] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:38:37 2022] GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:38:38.797590 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-3e820691-29c2-41df-87f7-b467c37ab31d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:38.798198 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-3e820691-29c2-41df-87f7-b467c37ab31d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:38.804953 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3e820691-29c2-41df-87f7-b467c37ab31d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:38.805436 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3e820691-29c2-41df-87f7-b467c37ab31d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:38.805870 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3e820691-29c2-41df-87f7-b467c37ab31d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:38.806191 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-c8529a3c-73d8-469b-b637-391da6fd0b19 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:38.806626 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3e820691-29c2-41df-87f7-b467c37ab31d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:38.806802 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-c8529a3c-73d8-469b-b637-391da6fd0b19 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: 9a0cc547-90fa-43de-b4f6-b1653194be5e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:38.807020 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3e820691-29c2-41df-87f7-b467c37ab31d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:38.807442 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3e820691-29c2-41df-87f7-b467c37ab31d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:38.813632 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c8529a3c-73d8-469b-b637-391da6fd0b19 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:38.814106 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c8529a3c-73d8-469b-b637-391da6fd0b19 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:38.814540 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c8529a3c-73d8-469b-b637-391da6fd0b19 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:38.815227 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c8529a3c-73d8-469b-b637-391da6fd0b19 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:38.815680 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c8529a3c-73d8-469b-b637-391da6fd0b19 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:38.816103 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c8529a3c-73d8-469b-b637-391da6fd0b19 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:38.936550 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-3e820691-29c2-41df-87f7-b467c37ab31d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:38.944566 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-c8529a3c-73d8-469b-b637-391da6fd0b19 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:38.944727 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-3e820691-29c2-41df-87f7-b467c37ab31d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:38.946121 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-3e820691-29c2-41df-87f7-b467c37ab31d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:38.947320 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-3e820691-29c2-41df-87f7-b467c37ab31d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1741 microversion: 2.20 time: 0.154146 Sep 30 19:38:38.947883 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 482/932] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:38:38 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1741 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:38:38.952851 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-c8529a3c-73d8-469b-b637-391da6fd0b19 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e" status: 200 len: 1266 microversion: 2.1 time: 0.150339 Sep 30 19:38:38.953441 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 451/933] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:38:38 2022] GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:38:39.973017 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-b734acc6-4b30-404d-8a8a-1769988e7ac2 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:39.973768 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-b734acc6-4b30-404d-8a8a-1769988e7ac2 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:39.975544 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-6817202a-c947-4427-ac5f-3b61a2a2f9b7 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:39.976150 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-6817202a-c947-4427-ac5f-3b61a2a2f9b7 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: 9a0cc547-90fa-43de-b4f6-b1653194be5e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:39.980321 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b734acc6-4b30-404d-8a8a-1769988e7ac2 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:39.980835 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b734acc6-4b30-404d-8a8a-1769988e7ac2 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:39.981860 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b734acc6-4b30-404d-8a8a-1769988e7ac2 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:39.982595 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b734acc6-4b30-404d-8a8a-1769988e7ac2 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:39.983048 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b734acc6-4b30-404d-8a8a-1769988e7ac2 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:39.983170 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6817202a-c947-4427-ac5f-3b61a2a2f9b7 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:39.983473 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b734acc6-4b30-404d-8a8a-1769988e7ac2 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:39.983575 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6817202a-c947-4427-ac5f-3b61a2a2f9b7 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:39.983949 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6817202a-c947-4427-ac5f-3b61a2a2f9b7 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:39.984668 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6817202a-c947-4427-ac5f-3b61a2a2f9b7 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:39.985119 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6817202a-c947-4427-ac5f-3b61a2a2f9b7 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:39.985538 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6817202a-c947-4427-ac5f-3b61a2a2f9b7 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:40.116103 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-6817202a-c947-4427-ac5f-3b61a2a2f9b7 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:40.117606 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-b734acc6-4b30-404d-8a8a-1769988e7ac2 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:40.124347 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-6817202a-c947-4427-ac5f-3b61a2a2f9b7 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e" status: 200 len: 1266 microversion: 2.1 time: 0.152517 Sep 30 19:38:40.124934 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 452/934] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:38:39 2022] GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:38:40.126161 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-b734acc6-4b30-404d-8a8a-1769988e7ac2 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:40.127612 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-b734acc6-4b30-404d-8a8a-1769988e7ac2 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:40.128804 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-b734acc6-4b30-404d-8a8a-1769988e7ac2 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1741 microversion: 2.20 time: 0.160126 Sep 30 19:38:40.129355 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 483/935] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:38:39 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1741 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:38:41.147762 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-a48e9c36-387c-46eb-bc51-4ac2cc171ece tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:41.148383 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-a48e9c36-387c-46eb-bc51-4ac2cc171ece tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: 9a0cc547-90fa-43de-b4f6-b1653194be5e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:41.154421 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-c9165154-7ddf-4f74-a318-901426a39038 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:41.154885 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a48e9c36-387c-46eb-bc51-4ac2cc171ece tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:41.155029 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-c9165154-7ddf-4f74-a318-901426a39038 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:41.155225 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a48e9c36-387c-46eb-bc51-4ac2cc171ece tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:41.155697 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a48e9c36-387c-46eb-bc51-4ac2cc171ece tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:41.156687 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a48e9c36-387c-46eb-bc51-4ac2cc171ece tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:41.157250 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a48e9c36-387c-46eb-bc51-4ac2cc171ece tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:41.157776 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a48e9c36-387c-46eb-bc51-4ac2cc171ece tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:41.161602 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c9165154-7ddf-4f74-a318-901426a39038 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:41.162086 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c9165154-7ddf-4f74-a318-901426a39038 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:41.162525 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c9165154-7ddf-4f74-a318-901426a39038 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:41.163259 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c9165154-7ddf-4f74-a318-901426a39038 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:41.163721 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c9165154-7ddf-4f74-a318-901426a39038 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:41.164144 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c9165154-7ddf-4f74-a318-901426a39038 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:41.287922 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-a48e9c36-387c-46eb-bc51-4ac2cc171ece tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:41.291370 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-c9165154-7ddf-4f74-a318-901426a39038 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:41.295984 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-a48e9c36-387c-46eb-bc51-4ac2cc171ece tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e" status: 200 len: 1266 microversion: 2.1 time: 0.151906 Sep 30 19:38:41.296978 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 453/936] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:38:41 2022] GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:38:41.299254 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-c9165154-7ddf-4f74-a318-901426a39038 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:41.300731 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-c9165154-7ddf-4f74-a318-901426a39038 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:41.301903 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-c9165154-7ddf-4f74-a318-901426a39038 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1741 microversion: 2.20 time: 0.151316 Sep 30 19:38:41.302458 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 484/937] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:38:41 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1741 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:38:42.320954 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-808fe731-27f0-4850-b37a-d07b89d4efc1 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:42.321560 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-808fe731-27f0-4850-b37a-d07b89d4efc1 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: 9a0cc547-90fa-43de-b4f6-b1653194be5e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:42.328298 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-808fe731-27f0-4850-b37a-d07b89d4efc1 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:42.328700 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-322946be-b4c2-44a7-946f-c2adfaf8c8f4 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:42.329158 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-808fe731-27f0-4850-b37a-d07b89d4efc1 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:42.329254 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-808fe731-27f0-4850-b37a-d07b89d4efc1 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:42.329542 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-322946be-b4c2-44a7-946f-c2adfaf8c8f4 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:42.329881 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-808fe731-27f0-4850-b37a-d07b89d4efc1 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:42.330342 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-808fe731-27f0-4850-b37a-d07b89d4efc1 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:42.330764 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-808fe731-27f0-4850-b37a-d07b89d4efc1 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:42.335706 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-322946be-b4c2-44a7-946f-c2adfaf8c8f4 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:42.336187 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-322946be-b4c2-44a7-946f-c2adfaf8c8f4 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:42.336841 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-322946be-b4c2-44a7-946f-c2adfaf8c8f4 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:42.337735 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-322946be-b4c2-44a7-946f-c2adfaf8c8f4 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:42.338195 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-322946be-b4c2-44a7-946f-c2adfaf8c8f4 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:42.338620 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-322946be-b4c2-44a7-946f-c2adfaf8c8f4 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:42.479835 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-808fe731-27f0-4850-b37a-d07b89d4efc1 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:42.487215 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-322946be-b4c2-44a7-946f-c2adfaf8c8f4 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:42.488032 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-808fe731-27f0-4850-b37a-d07b89d4efc1 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e" status: 200 len: 1266 microversion: 2.1 time: 0.170908 Sep 30 19:38:42.488654 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 454/938] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:38:42 2022] GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:38:42.493050 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-b8f7a989-987e-4802-bb47-d2e9556572f0 req-3a370d59-16a5-48e6-ae2b-81b320fa7bd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67a09687-3d87-4069-b17c-6ed9b6e96700", "name": "network-vif-plugged", "status": "completed", "tag": "c71e45c4-5abc-49db-8f88-3b7e95572f59"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:38:42.495805 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-322946be-b4c2-44a7-946f-c2adfaf8c8f4 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:42.497390 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-322946be-b4c2-44a7-946f-c2adfaf8c8f4 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:42.498728 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-322946be-b4c2-44a7-946f-c2adfaf8c8f4 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1741 microversion: 2.20 time: 0.174336 Sep 30 19:38:42.499526 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 485/939] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:38:42 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1741 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:38:42.502220 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-b8f7a989-987e-4802-bb47-d2e9556572f0 req-3a370d59-16a5-48e6-ae2b-81b320fa7bd9 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:42.502692 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-b8f7a989-987e-4802-bb47-d2e9556572f0 req-3a370d59-16a5-48e6-ae2b-81b320fa7bd9 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:42.503195 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-b8f7a989-987e-4802-bb47-d2e9556572f0 req-3a370d59-16a5-48e6-ae2b-81b320fa7bd9 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:42.514688 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-b8f7a989-987e-4802-bb47-d2e9556572f0 req-3a370d59-16a5-48e6-ae2b-81b320fa7bd9 service nova] Creating event network-vif-plugged:c71e45c4-5abc-49db-8f88-3b7e95572f59 for instance 67a09687-3d87-4069-b17c-6ed9b6e96700 on hv-cinder-86001 Sep 30 19:38:42.520036 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-b8f7a989-987e-4802-bb47-d2e9556572f0 req-3a370d59-16a5-48e6-ae2b-81b320fa7bd9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030310 Sep 30 19:38:42.520637 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 455/940] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:38:43.511146 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-f9f42cbd-4fb6-4e00-8aea-fb2927c01f6b tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:43.511790 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-f9f42cbd-4fb6-4e00-8aea-fb2927c01f6b tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: 9a0cc547-90fa-43de-b4f6-b1653194be5e] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:43.513629 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell0:SELECT=2 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:38:43.519213 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f9f42cbd-4fb6-4e00-8aea-fb2927c01f6b tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:43.519696 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f9f42cbd-4fb6-4e00-8aea-fb2927c01f6b tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:43.520142 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f9f42cbd-4fb6-4e00-8aea-fb2927c01f6b tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:43.520861 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f9f42cbd-4fb6-4e00-8aea-fb2927c01f6b tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:43.521318 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f9f42cbd-4fb6-4e00-8aea-fb2927c01f6b tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:43.521744 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f9f42cbd-4fb6-4e00-8aea-fb2927c01f6b tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:43.525841 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-c33909b5-d0cd-4312-bf23-52cff69691ae tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:43.526527 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-c33909b5-d0cd-4312-bf23-52cff69691ae tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:43.529067 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=2 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:38:43.529713 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=6 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:38:43.536563 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c33909b5-d0cd-4312-bf23-52cff69691ae tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:43.537041 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c33909b5-d0cd-4312-bf23-52cff69691ae tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:43.537472 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c33909b5-d0cd-4312-bf23-52cff69691ae tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:43.538160 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c33909b5-d0cd-4312-bf23-52cff69691ae tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:43.538608 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c33909b5-d0cd-4312-bf23-52cff69691ae tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:43.539030 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c33909b5-d0cd-4312-bf23-52cff69691ae tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:43.651946 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-f9f42cbd-4fb6-4e00-8aea-fb2927c01f6b tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:43.660642 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-f9f42cbd-4fb6-4e00-8aea-fb2927c01f6b tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e" status: 200 len: 1266 microversion: 2.1 time: 0.153209 Sep 30 19:38:43.661147 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 486/941] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:38:43 2022] GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:38:43.670561 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-c33909b5-d0cd-4312-bf23-52cff69691ae tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:43.678644 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-c33909b5-d0cd-4312-bf23-52cff69691ae tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:43.680088 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-c33909b5-d0cd-4312-bf23-52cff69691ae tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:43.681276 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-c33909b5-d0cd-4312-bf23-52cff69691ae tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1741 microversion: 2.20 time: 0.159589 Sep 30 19:38:43.681854 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 456/942] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:38:43 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1741 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:38:44.682952 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-6524c5de-6379-41fe-b98e-e588b29b4d6d tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:44.683561 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-6524c5de-6379-41fe-b98e-e588b29b4d6d tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: 9a0cc547-90fa-43de-b4f6-b1653194be5e] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:44.690811 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6524c5de-6379-41fe-b98e-e588b29b4d6d tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:44.691296 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6524c5de-6379-41fe-b98e-e588b29b4d6d tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:44.691736 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6524c5de-6379-41fe-b98e-e588b29b4d6d tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:44.692450 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6524c5de-6379-41fe-b98e-e588b29b4d6d tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:44.692906 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6524c5de-6379-41fe-b98e-e588b29b4d6d tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:44.693332 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6524c5de-6379-41fe-b98e-e588b29b4d6d tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:44.705985 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-9be8d1d5-2611-413f-af99-65eca50d1fe1 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:44.706617 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-9be8d1d5-2611-413f-af99-65eca50d1fe1 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:44.712812 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9be8d1d5-2611-413f-af99-65eca50d1fe1 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:44.713298 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9be8d1d5-2611-413f-af99-65eca50d1fe1 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:44.713748 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9be8d1d5-2611-413f-af99-65eca50d1fe1 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:44.714432 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9be8d1d5-2611-413f-af99-65eca50d1fe1 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:44.714942 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9be8d1d5-2611-413f-af99-65eca50d1fe1 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:44.715363 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9be8d1d5-2611-413f-af99-65eca50d1fe1 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:44.827662 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-6524c5de-6379-41fe-b98e-e588b29b4d6d tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:44.835383 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-6524c5de-6379-41fe-b98e-e588b29b4d6d tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e" status: 200 len: 1266 microversion: 2.1 time: 0.156317 Sep 30 19:38:44.835955 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 487/943] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:38:44 2022] GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:38:44.852391 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-9be8d1d5-2611-413f-af99-65eca50d1fe1 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:44.861003 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-9be8d1d5-2611-413f-af99-65eca50d1fe1 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:44.862421 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-9be8d1d5-2611-413f-af99-65eca50d1fe1 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:44.863571 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-9be8d1d5-2611-413f-af99-65eca50d1fe1 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1741 microversion: 2.20 time: 0.161417 Sep 30 19:38:44.864116 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 457/944] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:38:44 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1741 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:38:45.857823 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-4e8cc1f6-4958-40f2-bcba-3b91544e2d87 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:45.858536 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-4e8cc1f6-4958-40f2-bcba-3b91544e2d87 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: 9a0cc547-90fa-43de-b4f6-b1653194be5e] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:45.864810 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4e8cc1f6-4958-40f2-bcba-3b91544e2d87 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:45.865303 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4e8cc1f6-4958-40f2-bcba-3b91544e2d87 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:45.865741 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4e8cc1f6-4958-40f2-bcba-3b91544e2d87 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:45.866440 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4e8cc1f6-4958-40f2-bcba-3b91544e2d87 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:45.866894 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4e8cc1f6-4958-40f2-bcba-3b91544e2d87 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:45.867320 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4e8cc1f6-4958-40f2-bcba-3b91544e2d87 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:45.889228 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-735543d8-16c1-42cb-a32d-3b8ca35dee2c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:45.890588 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-735543d8-16c1-42cb-a32d-3b8ca35dee2c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:45.897300 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-735543d8-16c1-42cb-a32d-3b8ca35dee2c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:45.898325 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-735543d8-16c1-42cb-a32d-3b8ca35dee2c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:45.898757 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-735543d8-16c1-42cb-a32d-3b8ca35dee2c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:45.899448 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-735543d8-16c1-42cb-a32d-3b8ca35dee2c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:45.899897 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-735543d8-16c1-42cb-a32d-3b8ca35dee2c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:45.900316 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-735543d8-16c1-42cb-a32d-3b8ca35dee2c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:46.014850 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-4e8cc1f6-4958-40f2-bcba-3b91544e2d87 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:46.023375 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-4e8cc1f6-4958-40f2-bcba-3b91544e2d87 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e" status: 200 len: 1266 microversion: 2.1 time: 0.169414 Sep 30 19:38:46.023954 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 488/945] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:38:45 2022] GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:38:46.037740 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-735543d8-16c1-42cb-a32d-3b8ca35dee2c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:46.046370 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-735543d8-16c1-42cb-a32d-3b8ca35dee2c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:46.047813 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-735543d8-16c1-42cb-a32d-3b8ca35dee2c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:46.049019 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-735543d8-16c1-42cb-a32d-3b8ca35dee2c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1736 microversion: 2.20 time: 0.164419 Sep 30 19:38:46.049786 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 458/946] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:38:45 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:38:46.395118 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [req-ebc41604-7900-4990-9af3-17f995fda367 req-20dd505e-dcbf-4276-bb90-2bc60e926d65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a0cc547-90fa-43de-b4f6-b1653194be5e", "name": "network-vif-plugged", "status": "completed", "tag": "c7257cd3-8682-4d80-8650-53ef46de5429"}]} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:38:46.420328 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-ebc41604-7900-4990-9af3-17f995fda367 req-20dd505e-dcbf-4276-bb90-2bc60e926d65 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:46.420855 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-ebc41604-7900-4990-9af3-17f995fda367 req-20dd505e-dcbf-4276-bb90-2bc60e926d65 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:46.421336 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-ebc41604-7900-4990-9af3-17f995fda367 req-20dd505e-dcbf-4276-bb90-2bc60e926d65 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:46.442300 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.compute.server_external_events [req-ebc41604-7900-4990-9af3-17f995fda367 req-20dd505e-dcbf-4276-bb90-2bc60e926d65 service nova] Creating event network-vif-plugged:c7257cd3-8682-4d80-8650-53ef46de5429 for instance 9a0cc547-90fa-43de-b4f6-b1653194be5e on hv-cinder-86001 Sep 30 19:38:46.447871 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [req-ebc41604-7900-4990-9af3-17f995fda367 req-20dd505e-dcbf-4276-bb90-2bc60e926d65 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057632 Sep 30 19:38:46.448942 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 489/947] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:38:47.047044 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-fe45ce02-25e4-45e1-8902-5509641a19b2 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:47.047705 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-fe45ce02-25e4-45e1-8902-5509641a19b2 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: 9a0cc547-90fa-43de-b4f6-b1653194be5e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:47.054520 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fe45ce02-25e4-45e1-8902-5509641a19b2 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:47.055003 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fe45ce02-25e4-45e1-8902-5509641a19b2 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:47.055487 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fe45ce02-25e4-45e1-8902-5509641a19b2 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:47.056232 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fe45ce02-25e4-45e1-8902-5509641a19b2 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:47.057136 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fe45ce02-25e4-45e1-8902-5509641a19b2 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:47.058364 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fe45ce02-25e4-45e1-8902-5509641a19b2 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:47.078834 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-2c8c783a-769b-46ac-8c31-4ab3d6ed462f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:47.079527 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-2c8c783a-769b-46ac-8c31-4ab3d6ed462f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:47.086537 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2c8c783a-769b-46ac-8c31-4ab3d6ed462f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:47.087025 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2c8c783a-769b-46ac-8c31-4ab3d6ed462f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:47.087471 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2c8c783a-769b-46ac-8c31-4ab3d6ed462f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:47.088178 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2c8c783a-769b-46ac-8c31-4ab3d6ed462f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:47.088881 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2c8c783a-769b-46ac-8c31-4ab3d6ed462f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:47.089501 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2c8c783a-769b-46ac-8c31-4ab3d6ed462f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:47.235639 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-fe45ce02-25e4-45e1-8902-5509641a19b2 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:47.244664 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-fe45ce02-25e4-45e1-8902-5509641a19b2 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e" status: 200 len: 1266 microversion: 2.1 time: 0.201579 Sep 30 19:38:47.245441 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 459/948] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:38:47 2022] GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e => generated 1266 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:38:47.282411 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-2c8c783a-769b-46ac-8c31-4ab3d6ed462f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:47.291952 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-2c8c783a-769b-46ac-8c31-4ab3d6ed462f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:47.293467 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-2c8c783a-769b-46ac-8c31-4ab3d6ed462f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:47.294650 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-2c8c783a-769b-46ac-8c31-4ab3d6ed462f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1736 microversion: 2.20 time: 0.220761 Sep 30 19:38:47.295322 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 490/949] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:38:47 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1736 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:38:48.267136 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-2c7ec897-3124-420c-9bd9-5bc48d379c32 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:48.267838 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-2c7ec897-3124-420c-9bd9-5bc48d379c32 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: 9a0cc547-90fa-43de-b4f6-b1653194be5e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:48.270208 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:38:48.275536 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2c7ec897-3124-420c-9bd9-5bc48d379c32 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:48.276144 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2c7ec897-3124-420c-9bd9-5bc48d379c32 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:48.276850 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2c7ec897-3124-420c-9bd9-5bc48d379c32 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:48.277796 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2c7ec897-3124-420c-9bd9-5bc48d379c32 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:48.278476 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2c7ec897-3124-420c-9bd9-5bc48d379c32 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:48.279036 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2c7ec897-3124-420c-9bd9-5bc48d379c32 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:48.320138 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-c44ea9a0-7bea-432b-afaa-99fc340f7342 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:48.320765 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-c44ea9a0-7bea-432b-afaa-99fc340f7342 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:48.328257 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c44ea9a0-7bea-432b-afaa-99fc340f7342 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:48.329102 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c44ea9a0-7bea-432b-afaa-99fc340f7342 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:48.329747 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c44ea9a0-7bea-432b-afaa-99fc340f7342 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:48.330749 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c44ea9a0-7bea-432b-afaa-99fc340f7342 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:48.331380 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c44ea9a0-7bea-432b-afaa-99fc340f7342 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:48.331977 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c44ea9a0-7bea-432b-afaa-99fc340f7342 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:48.456822 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-2c7ec897-3124-420c-9bd9-5bc48d379c32 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:48.465065 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-2c7ec897-3124-420c-9bd9-5bc48d379c32 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e" status: 200 len: 1266 microversion: 2.1 time: 0.201719 Sep 30 19:38:48.465880 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 460/950] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:38:48 2022] GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e => generated 1266 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:38:48.514511 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-c44ea9a0-7bea-432b-afaa-99fc340f7342 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:48.523386 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-c44ea9a0-7bea-432b-afaa-99fc340f7342 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:48.525030 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-c44ea9a0-7bea-432b-afaa-99fc340f7342 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:48.526581 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-c44ea9a0-7bea-432b-afaa-99fc340f7342 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1736 microversion: 2.20 time: 0.210146 Sep 30 19:38:48.527275 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 491/951] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:38:48 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1736 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:38:49.488294 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-7d49a8f4-6462-4e44-be23-86fb84746493 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:49.489290 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-7d49a8f4-6462-4e44-be23-86fb84746493 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: 9a0cc547-90fa-43de-b4f6-b1653194be5e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:49.498478 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7d49a8f4-6462-4e44-be23-86fb84746493 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:49.499255 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7d49a8f4-6462-4e44-be23-86fb84746493 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:49.499889 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7d49a8f4-6462-4e44-be23-86fb84746493 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:49.501013 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7d49a8f4-6462-4e44-be23-86fb84746493 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:49.501480 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7d49a8f4-6462-4e44-be23-86fb84746493 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:49.501913 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7d49a8f4-6462-4e44-be23-86fb84746493 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:49.554040 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-69ded92a-5102-4035-b749-411e1be078e8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:49.554637 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-69ded92a-5102-4035-b749-411e1be078e8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:49.561957 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-69ded92a-5102-4035-b749-411e1be078e8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:49.562887 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-69ded92a-5102-4035-b749-411e1be078e8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:49.563651 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-69ded92a-5102-4035-b749-411e1be078e8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:49.564594 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-69ded92a-5102-4035-b749-411e1be078e8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:49.565258 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-69ded92a-5102-4035-b749-411e1be078e8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:49.565934 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-69ded92a-5102-4035-b749-411e1be078e8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:49.652669 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-7d49a8f4-6462-4e44-be23-86fb84746493 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:49.663730 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-7d49a8f4-6462-4e44-be23-86fb84746493 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e" status: 200 len: 1454 microversion: 2.1 time: 0.180256 Sep 30 19:38:49.664609 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 461/952] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:38:49 2022] GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e => generated 1454 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:38:49.687203 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-de5186f4-65e8-4c7d-bda9-5aceca64ca52 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:49.687823 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-de5186f4-65e8-4c7d-bda9-5aceca64ca52 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: 9a0cc547-90fa-43de-b4f6-b1653194be5e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:49.693866 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-de5186f4-65e8-4c7d-bda9-5aceca64ca52 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:49.694361 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-de5186f4-65e8-4c7d-bda9-5aceca64ca52 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:49.694806 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-de5186f4-65e8-4c7d-bda9-5aceca64ca52 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:49.695511 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-de5186f4-65e8-4c7d-bda9-5aceca64ca52 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:49.696152 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-de5186f4-65e8-4c7d-bda9-5aceca64ca52 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:49.696768 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-de5186f4-65e8-4c7d-bda9-5aceca64ca52 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:49.716709 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-69ded92a-5102-4035-b749-411e1be078e8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:49.726156 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-69ded92a-5102-4035-b749-411e1be078e8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:49.730149 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-69ded92a-5102-4035-b749-411e1be078e8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:49.731094 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-69ded92a-5102-4035-b749-411e1be078e8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1736 microversion: 2.20 time: 0.180934 Sep 30 19:38:49.734345 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 492/953] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:38:49 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1736 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:38:49.845682 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-de5186f4-65e8-4c7d-bda9-5aceca64ca52 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:49.854139 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-de5186f4-65e8-4c7d-bda9-5aceca64ca52 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e" status: 200 len: 1454 microversion: 2.1 time: 0.171208 Sep 30 19:38:49.854880 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 462/954] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:38:49 2022] GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e => generated 1454 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:38:50.761349 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-6471825c-d493-4c11-9df1-b4d8cb59f087 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:50.761928 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-6471825c-d493-4c11-9df1-b4d8cb59f087 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:50.769405 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6471825c-d493-4c11-9df1-b4d8cb59f087 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:50.769886 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6471825c-d493-4c11-9df1-b4d8cb59f087 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:50.770532 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6471825c-d493-4c11-9df1-b4d8cb59f087 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:50.771234 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6471825c-d493-4c11-9df1-b4d8cb59f087 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:50.771684 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6471825c-d493-4c11-9df1-b4d8cb59f087 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:50.772106 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6471825c-d493-4c11-9df1-b4d8cb59f087 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:50.915358 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-6471825c-d493-4c11-9df1-b4d8cb59f087 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:50.924713 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-6471825c-d493-4c11-9df1-b4d8cb59f087 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:50.927472 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-6471825c-d493-4c11-9df1-b4d8cb59f087 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:50.928953 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-6471825c-d493-4c11-9df1-b4d8cb59f087 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1736 microversion: 2.20 time: 0.171918 Sep 30 19:38:50.930040 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 493/955] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:38:50 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:38:51.956893 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-8cbee225-f3bd-4b8f-b32d-774101b34bd3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:51.958477 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-8cbee225-f3bd-4b8f-b32d-774101b34bd3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:51.966662 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8cbee225-f3bd-4b8f-b32d-774101b34bd3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:51.967243 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8cbee225-f3bd-4b8f-b32d-774101b34bd3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:51.967736 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8cbee225-f3bd-4b8f-b32d-774101b34bd3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:51.968755 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8cbee225-f3bd-4b8f-b32d-774101b34bd3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:51.969400 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8cbee225-f3bd-4b8f-b32d-774101b34bd3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:51.970181 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8cbee225-f3bd-4b8f-b32d-774101b34bd3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:52.112827 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [req-1753d8ab-ffcf-4e08-b7b0-9f99a25307c3 req-8e2d7451-9e45-4fed-b282-1c8e5502b329 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a0cc547-90fa-43de-b4f6-b1653194be5e", "tag": "c7257cd3-8682-4d80-8650-53ef46de5429"}]} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:38:52.130407 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-1753d8ab-ffcf-4e08-b7b0-9f99a25307c3 req-8e2d7451-9e45-4fed-b282-1c8e5502b329 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:52.131445 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-1753d8ab-ffcf-4e08-b7b0-9f99a25307c3 req-8e2d7451-9e45-4fed-b282-1c8e5502b329 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:52.132049 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-1753d8ab-ffcf-4e08-b7b0-9f99a25307c3 req-8e2d7451-9e45-4fed-b282-1c8e5502b329 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:52.146962 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.compute.server_external_events [req-1753d8ab-ffcf-4e08-b7b0-9f99a25307c3 req-8e2d7451-9e45-4fed-b282-1c8e5502b329 service nova] Creating event network-changed:c7257cd3-8682-4d80-8650-53ef46de5429 for instance 9a0cc547-90fa-43de-b4f6-b1653194be5e on hv-cinder-86001 Sep 30 19:38:52.154747 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [req-1753d8ab-ffcf-4e08-b7b0-9f99a25307c3 req-8e2d7451-9e45-4fed-b282-1c8e5502b329 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045186 Sep 30 19:38:52.156470 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 494/956] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 30 19:38:52.165512 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-8cbee225-f3bd-4b8f-b32d-774101b34bd3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:52.180761 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-8cbee225-f3bd-4b8f-b32d-774101b34bd3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:52.182210 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-8cbee225-f3bd-4b8f-b32d-774101b34bd3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:52.183469 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-8cbee225-f3bd-4b8f-b32d-774101b34bd3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1736 microversion: 2.20 time: 0.230485 Sep 30 19:38:52.204167 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 463/957] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:38:51 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1736 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:38:53.215156 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-1722797d-f422-4903-a28a-29d8bebcebb1 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:53.215921 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-1722797d-f422-4903-a28a-29d8bebcebb1 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:53.223922 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1722797d-f422-4903-a28a-29d8bebcebb1 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:53.224774 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1722797d-f422-4903-a28a-29d8bebcebb1 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:53.225416 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1722797d-f422-4903-a28a-29d8bebcebb1 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:53.228919 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1722797d-f422-4903-a28a-29d8bebcebb1 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:53.229693 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1722797d-f422-4903-a28a-29d8bebcebb1 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:53.230334 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1722797d-f422-4903-a28a-29d8bebcebb1 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:53.380712 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-1722797d-f422-4903-a28a-29d8bebcebb1 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:53.392403 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-1722797d-f422-4903-a28a-29d8bebcebb1 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:53.394017 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-1722797d-f422-4903-a28a-29d8bebcebb1 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:53.395821 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-1722797d-f422-4903-a28a-29d8bebcebb1 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1736 microversion: 2.20 time: 0.185659 Sep 30 19:38:53.396979 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 495/958] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:38:53 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1736 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:38:54.423604 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-a1de4b3d-f9a6-48f9-a7b9-639daf401726 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:54.424881 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-a1de4b3d-f9a6-48f9-a7b9-639daf401726 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:54.431702 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a1de4b3d-f9a6-48f9-a7b9-639daf401726 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:54.432381 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a1de4b3d-f9a6-48f9-a7b9-639daf401726 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:54.432825 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a1de4b3d-f9a6-48f9-a7b9-639daf401726 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:54.433683 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a1de4b3d-f9a6-48f9-a7b9-639daf401726 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:54.434426 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a1de4b3d-f9a6-48f9-a7b9-639daf401726 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:54.434755 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a1de4b3d-f9a6-48f9-a7b9-639daf401726 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:54.439111 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=100 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:38:54.579575 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-a1de4b3d-f9a6-48f9-a7b9-639daf401726 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:54.588511 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-a1de4b3d-f9a6-48f9-a7b9-639daf401726 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:54.589962 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-a1de4b3d-f9a6-48f9-a7b9-639daf401726 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:54.591750 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-a1de4b3d-f9a6-48f9-a7b9-639daf401726 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1736 microversion: 2.20 time: 0.171898 Sep 30 19:38:54.592328 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 464/959] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:38:54 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:38:55.617890 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-ea5ce543-ba45-4ada-b0f8-0138205addb5 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:55.618498 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-ea5ce543-ba45-4ada-b0f8-0138205addb5 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:55.625083 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ea5ce543-ba45-4ada-b0f8-0138205addb5 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:55.625562 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ea5ce543-ba45-4ada-b0f8-0138205addb5 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:55.625997 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ea5ce543-ba45-4ada-b0f8-0138205addb5 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:55.626684 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ea5ce543-ba45-4ada-b0f8-0138205addb5 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:55.627140 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ea5ce543-ba45-4ada-b0f8-0138205addb5 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:55.627564 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ea5ce543-ba45-4ada-b0f8-0138205addb5 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:55.756881 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-ea5ce543-ba45-4ada-b0f8-0138205addb5 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:55.764763 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-ea5ce543-ba45-4ada-b0f8-0138205addb5 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:55.766189 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-ea5ce543-ba45-4ada-b0f8-0138205addb5 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:55.767335 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-ea5ce543-ba45-4ada-b0f8-0138205addb5 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1736 microversion: 2.20 time: 0.153507 Sep 30 19:38:55.767887 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 496/960] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:38:55 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:38:56.792398 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-fd01bf31-c738-498d-a9ef-36b8fddb2055 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:56.793007 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-fd01bf31-c738-498d-a9ef-36b8fddb2055 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:56.799370 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fd01bf31-c738-498d-a9ef-36b8fddb2055 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:56.799846 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fd01bf31-c738-498d-a9ef-36b8fddb2055 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:56.800276 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fd01bf31-c738-498d-a9ef-36b8fddb2055 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:56.800984 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fd01bf31-c738-498d-a9ef-36b8fddb2055 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:56.801432 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fd01bf31-c738-498d-a9ef-36b8fddb2055 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:56.801850 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fd01bf31-c738-498d-a9ef-36b8fddb2055 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:56.935645 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-fd01bf31-c738-498d-a9ef-36b8fddb2055 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:56.943846 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-fd01bf31-c738-498d-a9ef-36b8fddb2055 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:56.945322 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-fd01bf31-c738-498d-a9ef-36b8fddb2055 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:56.946487 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-fd01bf31-c738-498d-a9ef-36b8fddb2055 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1718 microversion: 2.20 time: 0.157973 Sep 30 19:38:56.947042 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 465/961] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:38:56 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1718 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:38:57.972825 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-4011a2ef-58ac-4fa6-bf83-da6083ec2f2e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:57.973352 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-4011a2ef-58ac-4fa6-bf83-da6083ec2f2e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:57.980011 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4011a2ef-58ac-4fa6-bf83-da6083ec2f2e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:57.980522 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4011a2ef-58ac-4fa6-bf83-da6083ec2f2e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:57.980958 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4011a2ef-58ac-4fa6-bf83-da6083ec2f2e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:57.982240 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4011a2ef-58ac-4fa6-bf83-da6083ec2f2e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:57.982693 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4011a2ef-58ac-4fa6-bf83-da6083ec2f2e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:57.983113 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4011a2ef-58ac-4fa6-bf83-da6083ec2f2e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:57.985730 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell1:SELECT=100 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:38:58.112297 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-4011a2ef-58ac-4fa6-bf83-da6083ec2f2e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:58.120331 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-4011a2ef-58ac-4fa6-bf83-da6083ec2f2e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:58.121784 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-4011a2ef-58ac-4fa6-bf83-da6083ec2f2e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:58.122967 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-4011a2ef-58ac-4fa6-bf83-da6083ec2f2e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1718 microversion: 2.20 time: 0.154383 Sep 30 19:38:58.123526 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 497/962] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:38:57 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1718 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:38:59.148354 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-aaa452c0-f293-4e59-8203-e34c9ceb81c9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:59.148928 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-aaa452c0-f293-4e59-8203-e34c9ceb81c9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:59.155878 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-aaa452c0-f293-4e59-8203-e34c9ceb81c9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:59.156408 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-aaa452c0-f293-4e59-8203-e34c9ceb81c9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:59.156880 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-aaa452c0-f293-4e59-8203-e34c9ceb81c9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:59.157564 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-aaa452c0-f293-4e59-8203-e34c9ceb81c9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:59.158014 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-aaa452c0-f293-4e59-8203-e34c9ceb81c9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:59.158436 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-aaa452c0-f293-4e59-8203-e34c9ceb81c9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:59.283466 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-aaa452c0-f293-4e59-8203-e34c9ceb81c9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:59.291707 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-aaa452c0-f293-4e59-8203-e34c9ceb81c9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:59.293188 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-aaa452c0-f293-4e59-8203-e34c9ceb81c9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:38:59.294989 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-aaa452c0-f293-4e59-8203-e34c9ceb81c9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1721 microversion: 2.20 time: 0.149900 Sep 30 19:38:59.295545 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 466/963] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:38:59 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:38:59.319240 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-2cb7b5f0-942b-41b5-acd1-12b0b4b3d497 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1b06e632-1e51-4797-93cf-c9144999461c"}} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:38:59.321583 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-2cb7b5f0-942b-41b5-acd1-12b0b4b3d497 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:59.327841 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2cb7b5f0-942b-41b5-acd1-12b0b4b3d497 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:59.328317 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2cb7b5f0-942b-41b5-acd1-12b0b4b3d497 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:59.328792 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2cb7b5f0-942b-41b5-acd1-12b0b4b3d497 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:59.329472 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2cb7b5f0-942b-41b5-acd1-12b0b4b3d497 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:59.329920 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2cb7b5f0-942b-41b5-acd1-12b0b4b3d497 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:59.330346 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2cb7b5f0-942b-41b5-acd1-12b0b4b3d497 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:59.617712 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-2cb7b5f0-942b-41b5-acd1-12b0b4b3d497 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "POST /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.302380 Sep 30 19:38:59.618326 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 498/964] 10.222.0.17 () {62 vars in 1364 bytes} [Fri Sep 30 19:38:59 2022] POST /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700/os-volume_attachments => generated 188 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 30 19:38:59.741456 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-780a78b7-c296-4bee-981e-aa52dfed27ae tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:38:59.741989 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-780a78b7-c296-4bee-981e-aa52dfed27ae tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:38:59.747954 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-780a78b7-c296-4bee-981e-aa52dfed27ae tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:59.748552 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-780a78b7-c296-4bee-981e-aa52dfed27ae tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:59.749001 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-780a78b7-c296-4bee-981e-aa52dfed27ae tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:38:59.749696 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-780a78b7-c296-4bee-981e-aa52dfed27ae tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:38:59.750159 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-780a78b7-c296-4bee-981e-aa52dfed27ae tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:38:59.750587 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-780a78b7-c296-4bee-981e-aa52dfed27ae tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:00.018286 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-780a78b7-c296-4bee-981e-aa52dfed27ae tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "DELETE /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700/os-volume_attachments/1b06e632-1e51-4797-93cf-c9144999461c" status: 202 len: 0 microversion: 2.20 time: 0.280723 Sep 30 19:39:00.019014 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 467/965] 10.222.0.17 () {60 vars in 1457 bytes} [Fri Sep 30 19:38:59 2022] DELETE /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700/os-volume_attachments/1b06e632-1e51-4797-93cf-c9144999461c => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 30 19:39:00.078487 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-13d16f23-4675-40dd-ba74-0f170e0bd74a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:39:00.079061 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-13d16f23-4675-40dd-ba74-0f170e0bd74a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:39:00.085562 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-13d16f23-4675-40dd-ba74-0f170e0bd74a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:00.086046 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-13d16f23-4675-40dd-ba74-0f170e0bd74a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:00.086481 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-13d16f23-4675-40dd-ba74-0f170e0bd74a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:00.087164 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-13d16f23-4675-40dd-ba74-0f170e0bd74a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:00.087615 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-13d16f23-4675-40dd-ba74-0f170e0bd74a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:00.088041 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-13d16f23-4675-40dd-ba74-0f170e0bd74a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:00.115311 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-13d16f23-4675-40dd-ba74-0f170e0bd74a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120649) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 30 19:39:00.178980 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-13d16f23-4675-40dd-ba74-0f170e0bd74a tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "POST /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700/action" status: 202 len: 0 microversion: 2.20 time: 0.104942 Sep 30 19:39:00.179481 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 499/966] 10.222.0.17 () {62 vars in 1319 bytes} [Fri Sep 30 19:39:00 2022] POST /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 30 19:39:00.188860 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-20893bc8-91f1-4284-9454-85709dc569b2 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:39:00.189617 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-20893bc8-91f1-4284-9454-85709dc569b2 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:39:00.196700 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-20893bc8-91f1-4284-9454-85709dc569b2 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:00.197270 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-20893bc8-91f1-4284-9454-85709dc569b2 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:00.197716 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-20893bc8-91f1-4284-9454-85709dc569b2 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:00.198586 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-20893bc8-91f1-4284-9454-85709dc569b2 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:00.199153 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-20893bc8-91f1-4284-9454-85709dc569b2 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:00.199738 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-20893bc8-91f1-4284-9454-85709dc569b2 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:00.334265 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-20893bc8-91f1-4284-9454-85709dc569b2 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:00.343486 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-20893bc8-91f1-4284-9454-85709dc569b2 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:00.345105 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-20893bc8-91f1-4284-9454-85709dc569b2 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:00.346426 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-20893bc8-91f1-4284-9454-85709dc569b2 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1669 microversion: 2.20 time: 0.162312 Sep 30 19:39:00.347091 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 468/967] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:39:00 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1669 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:39:00.373741 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [req-a3d9cafa-64ef-4d81-8614-557c047f9b51 req-aa9b08e8-271a-42f9-b3d9-f6a2dbab3abf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67a09687-3d87-4069-b17c-6ed9b6e96700", "name": "network-vif-unplugged", "status": "completed", "tag": "c71e45c4-5abc-49db-8f88-3b7e95572f59"}]} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:39:00.383805 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-a3d9cafa-64ef-4d81-8614-557c047f9b51 req-aa9b08e8-271a-42f9-b3d9-f6a2dbab3abf service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:00.384527 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-a3d9cafa-64ef-4d81-8614-557c047f9b51 req-aa9b08e8-271a-42f9-b3d9-f6a2dbab3abf service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:00.385111 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-a3d9cafa-64ef-4d81-8614-557c047f9b51 req-aa9b08e8-271a-42f9-b3d9-f6a2dbab3abf service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:00.397131 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.compute.server_external_events [req-a3d9cafa-64ef-4d81-8614-557c047f9b51 req-aa9b08e8-271a-42f9-b3d9-f6a2dbab3abf service nova] Unable to find a host for instance 67a09687-3d87-4069-b17c-6ed9b6e96700. Dropping event network-vif-unplugged {{(pid=120649) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 30 19:39:00.398024 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [req-a3d9cafa-64ef-4d81-8614-557c047f9b51 req-aa9b08e8-271a-42f9-b3d9-f6a2dbab3abf service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030110 Sep 30 19:39:00.398612 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 500/968] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:39:00 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 30 19:39:01.372229 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-1ac384d8-dec5-473d-b52a-325a865ba79e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:39:01.372779 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-1ac384d8-dec5-473d-b52a-325a865ba79e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:39:01.379395 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1ac384d8-dec5-473d-b52a-325a865ba79e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:01.379883 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1ac384d8-dec5-473d-b52a-325a865ba79e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:01.380318 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1ac384d8-dec5-473d-b52a-325a865ba79e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:01.381205 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1ac384d8-dec5-473d-b52a-325a865ba79e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:01.381661 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1ac384d8-dec5-473d-b52a-325a865ba79e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:01.382086 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1ac384d8-dec5-473d-b52a-325a865ba79e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:01.566977 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-1ac384d8-dec5-473d-b52a-325a865ba79e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:01.575725 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-1ac384d8-dec5-473d-b52a-325a865ba79e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:01.577250 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-1ac384d8-dec5-473d-b52a-325a865ba79e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:01.578409 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-1ac384d8-dec5-473d-b52a-325a865ba79e tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1727 microversion: 2.20 time: 0.210169 Sep 30 19:39:01.579157 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 469/969] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:39:01 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1727 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:39:02.604964 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-f3a22d13-b5d4-4e55-8e15-edd3fd791ccd tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:39:02.605662 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-f3a22d13-b5d4-4e55-8e15-edd3fd791ccd tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:39:02.613369 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f3a22d13-b5d4-4e55-8e15-edd3fd791ccd tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:02.613857 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f3a22d13-b5d4-4e55-8e15-edd3fd791ccd tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:02.614300 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f3a22d13-b5d4-4e55-8e15-edd3fd791ccd tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:02.615010 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f3a22d13-b5d4-4e55-8e15-edd3fd791ccd tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:02.615465 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f3a22d13-b5d4-4e55-8e15-edd3fd791ccd tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:02.623412 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f3a22d13-b5d4-4e55-8e15-edd3fd791ccd tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:02.812942 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-f3a22d13-b5d4-4e55-8e15-edd3fd791ccd tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:02.821083 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-f3a22d13-b5d4-4e55-8e15-edd3fd791ccd tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:02.822522 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-f3a22d13-b5d4-4e55-8e15-edd3fd791ccd tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:02.823732 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-f3a22d13-b5d4-4e55-8e15-edd3fd791ccd tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1727 microversion: 2.20 time: 0.223241 Sep 30 19:39:02.824319 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 501/970] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:39:02 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1727 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:39:03.849422 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-ebe545b4-a9a7-44f6-be50-3935143100cc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:39:03.850784 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-ebe545b4-a9a7-44f6-be50-3935143100cc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:39:03.857832 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ebe545b4-a9a7-44f6-be50-3935143100cc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:03.858457 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ebe545b4-a9a7-44f6-be50-3935143100cc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:03.859005 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ebe545b4-a9a7-44f6-be50-3935143100cc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:03.859821 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ebe545b4-a9a7-44f6-be50-3935143100cc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:03.860404 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ebe545b4-a9a7-44f6-be50-3935143100cc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:03.861095 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ebe545b4-a9a7-44f6-be50-3935143100cc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:04.085469 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-2d7004bc-8ac4-4c18-969a-7d830515db96 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:39:04.086037 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-2d7004bc-8ac4-4c18-969a-7d830515db96 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: a7814c9b-5724-412b-9a58-99504793c39e] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:39:04.088352 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:39:04.093914 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2d7004bc-8ac4-4c18-969a-7d830515db96 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:04.094609 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2d7004bc-8ac4-4c18-969a-7d830515db96 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:04.095054 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2d7004bc-8ac4-4c18-969a-7d830515db96 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:04.095768 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2d7004bc-8ac4-4c18-969a-7d830515db96 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:04.096218 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2d7004bc-8ac4-4c18-969a-7d830515db96 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:04.096841 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2d7004bc-8ac4-4c18-969a-7d830515db96 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:04.123479 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-2d7004bc-8ac4-4c18-969a-7d830515db96 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e/ips" status: 200 len: 146 microversion: 2.1 time: 0.041677 Sep 30 19:39:04.124477 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 502/971] 10.222.0.17 () {58 vars in 1248 bytes} [Fri Sep 30 19:39:04 2022] GET /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e/ips => generated 146 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 30 19:39:04.153560 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-ebe545b4-a9a7-44f6-be50-3935143100cc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:04.162750 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-ebe545b4-a9a7-44f6-be50-3935143100cc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:04.164635 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-ebe545b4-a9a7-44f6-be50-3935143100cc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:04.165855 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-ebe545b4-a9a7-44f6-be50-3935143100cc tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1727 microversion: 2.20 time: 0.320326 Sep 30 19:39:04.176789 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 470/972] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:39:03 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1727 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:39:05.192921 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-f93fba6a-c37a-4412-814b-f643a28adc40 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:39:05.193664 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-f93fba6a-c37a-4412-814b-f643a28adc40 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:39:05.202197 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f93fba6a-c37a-4412-814b-f643a28adc40 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:05.203213 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f93fba6a-c37a-4412-814b-f643a28adc40 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:05.203213 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f93fba6a-c37a-4412-814b-f643a28adc40 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:05.203805 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f93fba6a-c37a-4412-814b-f643a28adc40 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:05.204465 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f93fba6a-c37a-4412-814b-f643a28adc40 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:05.205085 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f93fba6a-c37a-4412-814b-f643a28adc40 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:05.348490 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-f93fba6a-c37a-4412-814b-f643a28adc40 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:05.357208 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-f93fba6a-c37a-4412-814b-f643a28adc40 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:05.358812 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-f93fba6a-c37a-4412-814b-f643a28adc40 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:05.360042 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-f93fba6a-c37a-4412-814b-f643a28adc40 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1727 microversion: 2.20 time: 0.172102 Sep 30 19:39:05.360781 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 503/973] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:39:05 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1727 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:39:05.505524 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-58bccb43-b6fa-4d6e-b55d-21a8788d04b7 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55add08c-0860-469b-8bf5-e8c8df71b425"}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:39:05.508030 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-58bccb43-b6fa-4d6e-b55d-21a8788d04b7 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: a7814c9b-5724-412b-9a58-99504793c39e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:39:05.515710 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-58bccb43-b6fa-4d6e-b55d-21a8788d04b7 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:05.516288 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-58bccb43-b6fa-4d6e-b55d-21a8788d04b7 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:05.516871 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-58bccb43-b6fa-4d6e-b55d-21a8788d04b7 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:05.517581 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-58bccb43-b6fa-4d6e-b55d-21a8788d04b7 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:05.518098 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-58bccb43-b6fa-4d6e-b55d-21a8788d04b7 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:05.518600 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-58bccb43-b6fa-4d6e-b55d-21a8788d04b7 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:06.390715 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-ddd4cb25-2b31-4b6f-8e01-3d527f78ee07 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:39:06.391248 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-ddd4cb25-2b31-4b6f-8e01-3d527f78ee07 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:39:06.398299 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ddd4cb25-2b31-4b6f-8e01-3d527f78ee07 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:06.398798 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ddd4cb25-2b31-4b6f-8e01-3d527f78ee07 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:06.399243 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ddd4cb25-2b31-4b6f-8e01-3d527f78ee07 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:06.399958 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ddd4cb25-2b31-4b6f-8e01-3d527f78ee07 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:06.400442 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ddd4cb25-2b31-4b6f-8e01-3d527f78ee07 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:06.400880 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ddd4cb25-2b31-4b6f-8e01-3d527f78ee07 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:06.688968 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-ddd4cb25-2b31-4b6f-8e01-3d527f78ee07 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:06.697694 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-ddd4cb25-2b31-4b6f-8e01-3d527f78ee07 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:06.699127 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-ddd4cb25-2b31-4b6f-8e01-3d527f78ee07 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:06.700283 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-ddd4cb25-2b31-4b6f-8e01-3d527f78ee07 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1727 microversion: 2.20 time: 0.314272 Sep 30 19:39:06.700875 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 504/974] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:39:06 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1727 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:39:07.725469 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-83c1248c-68fa-4971-86fc-f15ce2cbfda7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:39:07.726200 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-83c1248c-68fa-4971-86fc-f15ce2cbfda7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:39:07.733094 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-83c1248c-68fa-4971-86fc-f15ce2cbfda7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:07.733585 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-83c1248c-68fa-4971-86fc-f15ce2cbfda7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:07.734023 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-83c1248c-68fa-4971-86fc-f15ce2cbfda7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:07.734727 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-83c1248c-68fa-4971-86fc-f15ce2cbfda7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:07.735184 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-83c1248c-68fa-4971-86fc-f15ce2cbfda7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:07.735612 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-83c1248c-68fa-4971-86fc-f15ce2cbfda7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:07.875835 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-83c1248c-68fa-4971-86fc-f15ce2cbfda7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:07.884278 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-83c1248c-68fa-4971-86fc-f15ce2cbfda7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:07.885750 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-83c1248c-68fa-4971-86fc-f15ce2cbfda7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:07.886959 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-83c1248c-68fa-4971-86fc-f15ce2cbfda7 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1727 microversion: 2.20 time: 0.165331 Sep 30 19:39:07.887505 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 505/975] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:39:07 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:39:08.912253 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-616a05a9-9869-4395-980c-9de2e021ac1b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:39:08.912931 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-616a05a9-9869-4395-980c-9de2e021ac1b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:39:08.919440 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-616a05a9-9869-4395-980c-9de2e021ac1b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:08.919929 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-616a05a9-9869-4395-980c-9de2e021ac1b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:08.920386 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-616a05a9-9869-4395-980c-9de2e021ac1b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:08.921084 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-616a05a9-9869-4395-980c-9de2e021ac1b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:08.921535 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-616a05a9-9869-4395-980c-9de2e021ac1b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:08.921957 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-616a05a9-9869-4395-980c-9de2e021ac1b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:09.060090 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-616a05a9-9869-4395-980c-9de2e021ac1b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:09.068907 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-616a05a9-9869-4395-980c-9de2e021ac1b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:09.070333 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-616a05a9-9869-4395-980c-9de2e021ac1b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:09.071533 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-616a05a9-9869-4395-980c-9de2e021ac1b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1727 microversion: 2.20 time: 0.163473 Sep 30 19:39:09.072075 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 506/976] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:39:08 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:39:10.098321 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-c54ace41-01f9-4850-8f36-1a6cfb891ed5 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:39:10.098998 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-c54ace41-01f9-4850-8f36-1a6cfb891ed5 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:39:10.105448 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c54ace41-01f9-4850-8f36-1a6cfb891ed5 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:10.105941 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c54ace41-01f9-4850-8f36-1a6cfb891ed5 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:10.106374 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c54ace41-01f9-4850-8f36-1a6cfb891ed5 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:10.107077 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c54ace41-01f9-4850-8f36-1a6cfb891ed5 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:10.108048 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c54ace41-01f9-4850-8f36-1a6cfb891ed5 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:10.108485 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c54ace41-01f9-4850-8f36-1a6cfb891ed5 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:10.240614 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-c54ace41-01f9-4850-8f36-1a6cfb891ed5 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:10.250449 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-c54ace41-01f9-4850-8f36-1a6cfb891ed5 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:10.251904 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-c54ace41-01f9-4850-8f36-1a6cfb891ed5 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:10.253122 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-c54ace41-01f9-4850-8f36-1a6cfb891ed5 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1727 microversion: 2.20 time: 0.158687 Sep 30 19:39:10.253680 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 507/977] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:39:10 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:39:11.278351 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-f5cf45b6-87cf-468c-bb51-bfde2b5a3af3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:39:11.279108 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-f5cf45b6-87cf-468c-bb51-bfde2b5a3af3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:39:11.285739 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f5cf45b6-87cf-468c-bb51-bfde2b5a3af3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:11.286220 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f5cf45b6-87cf-468c-bb51-bfde2b5a3af3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:11.286649 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f5cf45b6-87cf-468c-bb51-bfde2b5a3af3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:11.287333 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f5cf45b6-87cf-468c-bb51-bfde2b5a3af3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:11.287782 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f5cf45b6-87cf-468c-bb51-bfde2b5a3af3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:11.288206 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-f5cf45b6-87cf-468c-bb51-bfde2b5a3af3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:11.429342 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-f5cf45b6-87cf-468c-bb51-bfde2b5a3af3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:11.438079 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-f5cf45b6-87cf-468c-bb51-bfde2b5a3af3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:11.439513 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-f5cf45b6-87cf-468c-bb51-bfde2b5a3af3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:11.440720 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-f5cf45b6-87cf-468c-bb51-bfde2b5a3af3 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1727 microversion: 2.20 time: 0.166240 Sep 30 19:39:11.441610 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 508/978] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:39:11 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:39:12.466714 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-524d4dca-7809-48f7-b606-2c88b5b77f84 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:39:12.467405 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-524d4dca-7809-48f7-b606-2c88b5b77f84 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:39:12.474476 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-524d4dca-7809-48f7-b606-2c88b5b77f84 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:12.474974 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-524d4dca-7809-48f7-b606-2c88b5b77f84 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:12.475414 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-524d4dca-7809-48f7-b606-2c88b5b77f84 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:12.476118 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-524d4dca-7809-48f7-b606-2c88b5b77f84 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:12.476603 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-524d4dca-7809-48f7-b606-2c88b5b77f84 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:12.477037 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-524d4dca-7809-48f7-b606-2c88b5b77f84 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:12.620765 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-524d4dca-7809-48f7-b606-2c88b5b77f84 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:12.629374 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-524d4dca-7809-48f7-b606-2c88b5b77f84 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:12.630822 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-524d4dca-7809-48f7-b606-2c88b5b77f84 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:12.631988 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-524d4dca-7809-48f7-b606-2c88b5b77f84 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1727 microversion: 2.20 time: 0.169512 Sep 30 19:39:12.632567 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 509/979] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:39:12 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1727 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:39:13.658524 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-d2166e44-0c22-4df2-8a2d-47b872cfc3ca tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:39:13.659190 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-d2166e44-0c22-4df2-8a2d-47b872cfc3ca tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:39:13.665752 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d2166e44-0c22-4df2-8a2d-47b872cfc3ca tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:13.666238 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d2166e44-0c22-4df2-8a2d-47b872cfc3ca tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:13.666676 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d2166e44-0c22-4df2-8a2d-47b872cfc3ca tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:13.667371 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d2166e44-0c22-4df2-8a2d-47b872cfc3ca tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:13.667833 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d2166e44-0c22-4df2-8a2d-47b872cfc3ca tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:13.668259 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d2166e44-0c22-4df2-8a2d-47b872cfc3ca tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:13.799383 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-d2166e44-0c22-4df2-8a2d-47b872cfc3ca tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:13.807836 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-d2166e44-0c22-4df2-8a2d-47b872cfc3ca tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:13.809321 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-d2166e44-0c22-4df2-8a2d-47b872cfc3ca tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:13.810604 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-d2166e44-0c22-4df2-8a2d-47b872cfc3ca tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1727 microversion: 2.20 time: 0.156717 Sep 30 19:39:13.811205 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 510/980] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:39:13 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:39:14.836178 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-a47315ef-e1c3-4a94-b7e1-0bd7183c458c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:39:14.837009 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-a47315ef-e1c3-4a94-b7e1-0bd7183c458c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:39:14.843881 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a47315ef-e1c3-4a94-b7e1-0bd7183c458c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:14.844381 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a47315ef-e1c3-4a94-b7e1-0bd7183c458c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:14.844834 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a47315ef-e1c3-4a94-b7e1-0bd7183c458c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:14.845523 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a47315ef-e1c3-4a94-b7e1-0bd7183c458c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:14.845983 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a47315ef-e1c3-4a94-b7e1-0bd7183c458c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:14.846410 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a47315ef-e1c3-4a94-b7e1-0bd7183c458c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:14.850672 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:39:14.997637 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-a47315ef-e1c3-4a94-b7e1-0bd7183c458c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:15.006120 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-a47315ef-e1c3-4a94-b7e1-0bd7183c458c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:15.007562 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-a47315ef-e1c3-4a94-b7e1-0bd7183c458c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:15.008766 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-a47315ef-e1c3-4a94-b7e1-0bd7183c458c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1727 microversion: 2.20 time: 0.176607 Sep 30 19:39:15.009323 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 511/981] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:39:14 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1727 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:39:15.513390 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=23 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:39:15.593303 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=56,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:39:16.035184 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-d3fd310d-b48b-4e8b-ae21-4863596e9b11 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:39:16.035793 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-d3fd310d-b48b-4e8b-ae21-4863596e9b11 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:39:16.042266 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d3fd310d-b48b-4e8b-ae21-4863596e9b11 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:16.042751 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d3fd310d-b48b-4e8b-ae21-4863596e9b11 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:16.043189 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d3fd310d-b48b-4e8b-ae21-4863596e9b11 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:16.043882 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d3fd310d-b48b-4e8b-ae21-4863596e9b11 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:16.044340 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d3fd310d-b48b-4e8b-ae21-4863596e9b11 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:16.044798 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d3fd310d-b48b-4e8b-ae21-4863596e9b11 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:16.174752 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-d3fd310d-b48b-4e8b-ae21-4863596e9b11 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:16.182714 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-d3fd310d-b48b-4e8b-ae21-4863596e9b11 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:16.184596 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-d3fd310d-b48b-4e8b-ae21-4863596e9b11 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:16.186094 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-d3fd310d-b48b-4e8b-ae21-4863596e9b11 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1727 microversion: 2.20 time: 0.155590 Sep 30 19:39:16.186658 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 512/982] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:39:16 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:39:16.617694 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-58bccb43-b6fa-4d6e-b55d-21a8788d04b7 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "POST /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 11.116083 Sep 30 19:39:16.618297 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 471/983] 10.222.0.17 () {60 vars in 1323 bytes} [Fri Sep 30 19:39:05 2022] POST /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e/os-volume_attachments => generated 194 bytes in 11118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:39:17.211611 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-ee4f0907-4b29-48fe-9aec-cb0c0f2133c8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:39:17.212923 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-ee4f0907-4b29-48fe-9aec-cb0c0f2133c8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:39:17.219948 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ee4f0907-4b29-48fe-9aec-cb0c0f2133c8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:17.220462 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ee4f0907-4b29-48fe-9aec-cb0c0f2133c8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:17.220930 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ee4f0907-4b29-48fe-9aec-cb0c0f2133c8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:17.221627 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ee4f0907-4b29-48fe-9aec-cb0c0f2133c8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:17.222081 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ee4f0907-4b29-48fe-9aec-cb0c0f2133c8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:17.222506 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ee4f0907-4b29-48fe-9aec-cb0c0f2133c8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:17.346588 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-ee4f0907-4b29-48fe-9aec-cb0c0f2133c8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:17.354935 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-ee4f0907-4b29-48fe-9aec-cb0c0f2133c8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:17.356400 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-ee4f0907-4b29-48fe-9aec-cb0c0f2133c8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:17.357597 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-ee4f0907-4b29-48fe-9aec-cb0c0f2133c8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1727 microversion: 2.20 time: 0.149902 Sep 30 19:39:17.358160 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 513/984] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:39:17 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:39:18.509233 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-492e19bc-aac1-4ad4-96a9-7591d813d630 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:39:18.509926 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-492e19bc-aac1-4ad4-96a9-7591d813d630 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:39:18.516811 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-492e19bc-aac1-4ad4-96a9-7591d813d630 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:18.517287 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-492e19bc-aac1-4ad4-96a9-7591d813d630 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:18.517717 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-492e19bc-aac1-4ad4-96a9-7591d813d630 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:18.518398 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-492e19bc-aac1-4ad4-96a9-7591d813d630 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:18.518847 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-492e19bc-aac1-4ad4-96a9-7591d813d630 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:18.519268 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-492e19bc-aac1-4ad4-96a9-7591d813d630 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:18.650507 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-492e19bc-aac1-4ad4-96a9-7591d813d630 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:18.658468 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-492e19bc-aac1-4ad4-96a9-7591d813d630 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:18.659886 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-492e19bc-aac1-4ad4-96a9-7591d813d630 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:18.661322 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-492e19bc-aac1-4ad4-96a9-7591d813d630 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1727 microversion: 2.20 time: 0.282001 Sep 30 19:39:18.661888 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 472/985] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:39:18 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1727 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:39:19.686453 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-5fb041f5-bb76-49a2-b946-a166d9c7343f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:39:19.687103 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-5fb041f5-bb76-49a2-b946-a166d9c7343f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:39:19.693581 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5fb041f5-bb76-49a2-b946-a166d9c7343f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:19.694075 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5fb041f5-bb76-49a2-b946-a166d9c7343f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:19.694526 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5fb041f5-bb76-49a2-b946-a166d9c7343f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:19.695282 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5fb041f5-bb76-49a2-b946-a166d9c7343f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:19.695748 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5fb041f5-bb76-49a2-b946-a166d9c7343f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:19.696177 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5fb041f5-bb76-49a2-b946-a166d9c7343f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:19.827520 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-5fb041f5-bb76-49a2-b946-a166d9c7343f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:19.837079 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-5fb041f5-bb76-49a2-b946-a166d9c7343f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:19.838742 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-5fb041f5-bb76-49a2-b946-a166d9c7343f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:19.840120 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-5fb041f5-bb76-49a2-b946-a166d9c7343f tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1727 microversion: 2.20 time: 0.157617 Sep 30 19:39:19.841146 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 514/986] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:39:19 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:39:20.866270 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-ac60270a-d9c9-4b17-b3c3-3d44bbcf5c49 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:39:20.866949 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-ac60270a-d9c9-4b17-b3c3-3d44bbcf5c49 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:39:20.873483 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ac60270a-d9c9-4b17-b3c3-3d44bbcf5c49 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:20.873975 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ac60270a-d9c9-4b17-b3c3-3d44bbcf5c49 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:20.874415 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ac60270a-d9c9-4b17-b3c3-3d44bbcf5c49 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:20.875121 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ac60270a-d9c9-4b17-b3c3-3d44bbcf5c49 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:20.875578 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ac60270a-d9c9-4b17-b3c3-3d44bbcf5c49 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:20.876006 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ac60270a-d9c9-4b17-b3c3-3d44bbcf5c49 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:21.001942 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-ac60270a-d9c9-4b17-b3c3-3d44bbcf5c49 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:21.009839 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-ac60270a-d9c9-4b17-b3c3-3d44bbcf5c49 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:21.011292 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-ac60270a-d9c9-4b17-b3c3-3d44bbcf5c49 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:21.012473 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-ac60270a-d9c9-4b17-b3c3-3d44bbcf5c49 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1727 microversion: 2.20 time: 0.150144 Sep 30 19:39:21.013026 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 473/987] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:39:20 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:39:22.037531 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-3e371130-8c68-4ad3-8b87-3e1d74e408b8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:39:22.038149 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-3e371130-8c68-4ad3-8b87-3e1d74e408b8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:39:22.044775 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3e371130-8c68-4ad3-8b87-3e1d74e408b8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:22.045261 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3e371130-8c68-4ad3-8b87-3e1d74e408b8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:22.045697 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3e371130-8c68-4ad3-8b87-3e1d74e408b8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:22.046390 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3e371130-8c68-4ad3-8b87-3e1d74e408b8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:22.046845 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3e371130-8c68-4ad3-8b87-3e1d74e408b8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:22.047269 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3e371130-8c68-4ad3-8b87-3e1d74e408b8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:22.175380 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-3e371130-8c68-4ad3-8b87-3e1d74e408b8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:22.183195 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-3e371130-8c68-4ad3-8b87-3e1d74e408b8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:22.185037 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-3e371130-8c68-4ad3-8b87-3e1d74e408b8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:22.186371 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-3e371130-8c68-4ad3-8b87-3e1d74e408b8 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1727 microversion: 2.20 time: 0.152881 Sep 30 19:39:22.186915 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 515/988] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:39:22 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:39:22.562810 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-48629fd1-722c-4ba7-baf3-f9066ae9c286 req-0aa61fa9-67ea-45b0-a1f1-fdaf7c8f3166 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67a09687-3d87-4069-b17c-6ed9b6e96700", "name": "network-vif-plugged", "status": "completed", "tag": "c71e45c4-5abc-49db-8f88-3b7e95572f59"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:39:22.574758 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-48629fd1-722c-4ba7-baf3-f9066ae9c286 req-0aa61fa9-67ea-45b0-a1f1-fdaf7c8f3166 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:22.575240 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-48629fd1-722c-4ba7-baf3-f9066ae9c286 req-0aa61fa9-67ea-45b0-a1f1-fdaf7c8f3166 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:22.577067 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-48629fd1-722c-4ba7-baf3-f9066ae9c286 req-0aa61fa9-67ea-45b0-a1f1-fdaf7c8f3166 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:22.587888 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-48629fd1-722c-4ba7-baf3-f9066ae9c286 req-0aa61fa9-67ea-45b0-a1f1-fdaf7c8f3166 service nova] Creating event network-vif-plugged:c71e45c4-5abc-49db-8f88-3b7e95572f59 for instance 67a09687-3d87-4069-b17c-6ed9b6e96700 on hv-cinder-86001 Sep 30 19:39:22.592843 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-48629fd1-722c-4ba7-baf3-f9066ae9c286 req-0aa61fa9-67ea-45b0-a1f1-fdaf7c8f3166 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033727 Sep 30 19:39:22.593419 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 474/989] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:39:23.211324 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-7ac1c9cd-dc09-4748-ba0f-27077e98eedb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:39:23.211940 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-7ac1c9cd-dc09-4748-ba0f-27077e98eedb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:39:23.218534 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7ac1c9cd-dc09-4748-ba0f-27077e98eedb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:23.219023 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7ac1c9cd-dc09-4748-ba0f-27077e98eedb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:23.219468 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7ac1c9cd-dc09-4748-ba0f-27077e98eedb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:23.220792 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7ac1c9cd-dc09-4748-ba0f-27077e98eedb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:23.221254 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7ac1c9cd-dc09-4748-ba0f-27077e98eedb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:23.221687 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7ac1c9cd-dc09-4748-ba0f-27077e98eedb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:23.593197 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-7ac1c9cd-dc09-4748-ba0f-27077e98eedb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:23.601556 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-7ac1c9cd-dc09-4748-ba0f-27077e98eedb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:23.603000 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-7ac1c9cd-dc09-4748-ba0f-27077e98eedb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:23.604179 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-7ac1c9cd-dc09-4748-ba0f-27077e98eedb tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1727 microversion: 2.20 time: 0.396791 Sep 30 19:39:23.604772 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 516/990] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:39:23 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1727 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:39:24.630756 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-c8cdebf8-335f-4997-b676-9c765a21d19c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:39:24.631501 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-c8cdebf8-335f-4997-b676-9c765a21d19c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:39:24.638405 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c8cdebf8-335f-4997-b676-9c765a21d19c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:24.639011 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c8cdebf8-335f-4997-b676-9c765a21d19c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:24.639447 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c8cdebf8-335f-4997-b676-9c765a21d19c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:24.640134 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c8cdebf8-335f-4997-b676-9c765a21d19c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:24.640619 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c8cdebf8-335f-4997-b676-9c765a21d19c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:24.641039 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c8cdebf8-335f-4997-b676-9c765a21d19c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:24.780548 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-c8cdebf8-335f-4997-b676-9c765a21d19c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:24.789159 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-c8cdebf8-335f-4997-b676-9c765a21d19c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:24.790586 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-c8cdebf8-335f-4997-b676-9c765a21d19c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:24.791734 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-c8cdebf8-335f-4997-b676-9c765a21d19c tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1727 microversion: 2.20 time: 0.166092 Sep 30 19:39:24.792358 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 475/991] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:39:24 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:39:25.817882 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-193bc2f4-c611-4937-af3d-60f05fe01cd4 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:39:25.818482 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-193bc2f4-c611-4937-af3d-60f05fe01cd4 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:39:25.824519 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-193bc2f4-c611-4937-af3d-60f05fe01cd4 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:25.825000 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-193bc2f4-c611-4937-af3d-60f05fe01cd4 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:25.825436 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-193bc2f4-c611-4937-af3d-60f05fe01cd4 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:25.826118 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-193bc2f4-c611-4937-af3d-60f05fe01cd4 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:25.826565 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-193bc2f4-c611-4937-af3d-60f05fe01cd4 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:25.826983 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-193bc2f4-c611-4937-af3d-60f05fe01cd4 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:25.952780 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-193bc2f4-c611-4937-af3d-60f05fe01cd4 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:25.961408 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-193bc2f4-c611-4937-af3d-60f05fe01cd4 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:25.962839 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-193bc2f4-c611-4937-af3d-60f05fe01cd4 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:25.964020 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-193bc2f4-c611-4937-af3d-60f05fe01cd4 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1714 microversion: 2.20 time: 0.150510 Sep 30 19:39:25.964597 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 517/992] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:39:25 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1714 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:39:27.325768 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-81dac807-c78d-41ef-95aa-2de720e6dcdd tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:39:27.328046 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-81dac807-c78d-41ef-95aa-2de720e6dcdd tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: a7814c9b-5724-412b-9a58-99504793c39e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:39:27.335102 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-81dac807-c78d-41ef-95aa-2de720e6dcdd tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:27.335590 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-81dac807-c78d-41ef-95aa-2de720e6dcdd tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:27.336029 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-81dac807-c78d-41ef-95aa-2de720e6dcdd tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:27.336754 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-81dac807-c78d-41ef-95aa-2de720e6dcdd tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:27.337214 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-81dac807-c78d-41ef-95aa-2de720e6dcdd tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:27.337643 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-81dac807-c78d-41ef-95aa-2de720e6dcdd tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:27.365946 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-81dac807-c78d-41ef-95aa-2de720e6dcdd tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044034 Sep 30 19:39:27.366473 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 476/993] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 30 19:39:27 2022] GET /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 30 19:39:27.377625 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-56e7f9df-488e-4595-9f0c-ed55f6c89258 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:39:27.378109 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-56e7f9df-488e-4595-9f0c-ed55f6c89258 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: a7814c9b-5724-412b-9a58-99504793c39e] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:39:27.384651 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-56e7f9df-488e-4595-9f0c-ed55f6c89258 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:27.385144 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-56e7f9df-488e-4595-9f0c-ed55f6c89258 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:27.385589 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-56e7f9df-488e-4595-9f0c-ed55f6c89258 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:27.386350 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-56e7f9df-488e-4595-9f0c-ed55f6c89258 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:27.386817 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-56e7f9df-488e-4595-9f0c-ed55f6c89258 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:27.387308 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-56e7f9df-488e-4595-9f0c-ed55f6c89258 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:27.416819 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-56e7f9df-488e-4595-9f0c-ed55f6c89258 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e/os-volume_attachments/55add08c-0860-469b-8bf5-e8c8df71b425" status: 200 len: 194 microversion: 2.1 time: 0.043598 Sep 30 19:39:27.417394 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 518/994] 10.222.0.17 () {58 vars in 1413 bytes} [Fri Sep 30 19:39:27 2022] GET /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e/os-volume_attachments/55add08c-0860-469b-8bf5-e8c8df71b425 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:39:28.739494 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-21677bf8-547b-4378-8c42-7dd751953722 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7547b3b3-3632-4309-9bcd-db9f1095a433"}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:39:28.741833 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-21677bf8-547b-4378-8c42-7dd751953722 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: a7814c9b-5724-412b-9a58-99504793c39e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:39:28.748132 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-21677bf8-547b-4378-8c42-7dd751953722 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:28.748642 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-21677bf8-547b-4378-8c42-7dd751953722 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:28.749074 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-21677bf8-547b-4378-8c42-7dd751953722 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:28.749752 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-21677bf8-547b-4378-8c42-7dd751953722 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:28.750201 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-21677bf8-547b-4378-8c42-7dd751953722 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:28.750627 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-21677bf8-547b-4378-8c42-7dd751953722 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:29.009927 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-21677bf8-547b-4378-8c42-7dd751953722 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "POST /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274197 Sep 30 19:39:29.010575 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 477/995] 10.222.0.17 () {60 vars in 1323 bytes} [Fri Sep 30 19:39:28 2022] POST /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:39:36.543067 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-0ec29335-83cd-4b11-9b00-ae8e36a5486f tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:39:36.545351 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-0ec29335-83cd-4b11-9b00-ae8e36a5486f tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: a7814c9b-5724-412b-9a58-99504793c39e] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:39:36.547743 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_api:SELECT=34 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:39:36.553054 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0ec29335-83cd-4b11-9b00-ae8e36a5486f tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:36.553540 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0ec29335-83cd-4b11-9b00-ae8e36a5486f tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:36.553979 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0ec29335-83cd-4b11-9b00-ae8e36a5486f tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:36.554671 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0ec29335-83cd-4b11-9b00-ae8e36a5486f tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:36.555128 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0ec29335-83cd-4b11-9b00-ae8e36a5486f tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:36.555557 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0ec29335-83cd-4b11-9b00-ae8e36a5486f tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:36.585004 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-0ec29335-83cd-4b11-9b00-ae8e36a5486f tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045830 Sep 30 19:39:36.585545 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 519/996] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 30 19:39:36 2022] GET /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:39:36.682494 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-23f79d72-0c03-4ea2-9ae7-7baddfb5aa47 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:39:36.683073 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-23f79d72-0c03-4ea2-9ae7-7baddfb5aa47 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: a7814c9b-5724-412b-9a58-99504793c39e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:39:36.690269 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-23f79d72-0c03-4ea2-9ae7-7baddfb5aa47 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:36.690760 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-23f79d72-0c03-4ea2-9ae7-7baddfb5aa47 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:36.691192 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-23f79d72-0c03-4ea2-9ae7-7baddfb5aa47 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:36.691885 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-23f79d72-0c03-4ea2-9ae7-7baddfb5aa47 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:36.692337 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-23f79d72-0c03-4ea2-9ae7-7baddfb5aa47 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:36.692787 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-23f79d72-0c03-4ea2-9ae7-7baddfb5aa47 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:36.721726 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-23f79d72-0c03-4ea2-9ae7-7baddfb5aa47 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e/os-volume_attachments/55add08c-0860-469b-8bf5-e8c8df71b425" status: 200 len: 194 microversion: 2.1 time: 0.043751 Sep 30 19:39:36.722329 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 478/997] 10.222.0.17 () {58 vars in 1413 bytes} [Fri Sep 30 19:39:36 2022] GET /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e/os-volume_attachments/55add08c-0860-469b-8bf5-e8c8df71b425 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:39:36.732891 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-8363cd6f-aa37-4b6b-804f-1398af556c70 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:39:36.733442 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-8363cd6f-aa37-4b6b-804f-1398af556c70 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: a7814c9b-5724-412b-9a58-99504793c39e] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:39:36.739342 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8363cd6f-aa37-4b6b-804f-1398af556c70 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:36.739830 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8363cd6f-aa37-4b6b-804f-1398af556c70 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:36.740271 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8363cd6f-aa37-4b6b-804f-1398af556c70 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:36.741069 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8363cd6f-aa37-4b6b-804f-1398af556c70 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:36.741529 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8363cd6f-aa37-4b6b-804f-1398af556c70 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:36.741956 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8363cd6f-aa37-4b6b-804f-1398af556c70 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:36.819694 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.objects.instance [None req-8363cd6f-aa37-4b6b-804f-1398af556c70 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lazy-loading 'services' on Instance uuid a7814c9b-5724-412b-9a58-99504793c39e {{(pid=120649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 30 19:39:36.894907 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-8363cd6f-aa37-4b6b-804f-1398af556c70 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e/os-volume_attachments/55add08c-0860-469b-8bf5-e8c8df71b425" status: 202 len: 0 microversion: 2.1 time: 0.165707 Sep 30 19:39:36.895520 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 520/998] 10.222.0.17 () {58 vars in 1416 bytes} [Fri Sep 30 19:39:36 2022] DELETE /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e/os-volume_attachments/55add08c-0860-469b-8bf5-e8c8df71b425 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 30 19:39:39.071593 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-087ed3d6-7ecb-44a0-97ea-7c886fffc219 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:39:39.072089 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-087ed3d6-7ecb-44a0-97ea-7c886fffc219 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: a7814c9b-5724-412b-9a58-99504793c39e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:39:39.078549 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-087ed3d6-7ecb-44a0-97ea-7c886fffc219 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:39.079577 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-087ed3d6-7ecb-44a0-97ea-7c886fffc219 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:39.080010 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-087ed3d6-7ecb-44a0-97ea-7c886fffc219 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:39.080719 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-087ed3d6-7ecb-44a0-97ea-7c886fffc219 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:39.081169 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-087ed3d6-7ecb-44a0-97ea-7c886fffc219 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:39.081592 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-087ed3d6-7ecb-44a0-97ea-7c886fffc219 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:39.109560 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-087ed3d6-7ecb-44a0-97ea-7c886fffc219 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e/os-volume_attachments/7547b3b3-3632-4309-9bcd-db9f1095a433" status: 200 len: 194 microversion: 2.1 time: 0.041958 Sep 30 19:39:39.110145 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 479/999] 10.222.0.17 () {58 vars in 1413 bytes} [Fri Sep 30 19:39:39 2022] GET /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e/os-volume_attachments/7547b3b3-3632-4309-9bcd-db9f1095a433 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:39:39.121690 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-91a60cbb-74e8-45f6-88d6-be6b26012461 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:39:39.122509 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-91a60cbb-74e8-45f6-88d6-be6b26012461 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: a7814c9b-5724-412b-9a58-99504793c39e] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:39:39.129272 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-91a60cbb-74e8-45f6-88d6-be6b26012461 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:39.129768 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-91a60cbb-74e8-45f6-88d6-be6b26012461 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:39.130215 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-91a60cbb-74e8-45f6-88d6-be6b26012461 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:39.130910 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-91a60cbb-74e8-45f6-88d6-be6b26012461 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:39.131371 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-91a60cbb-74e8-45f6-88d6-be6b26012461 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:39.131801 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-91a60cbb-74e8-45f6-88d6-be6b26012461 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:39.211559 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.objects.instance [None req-91a60cbb-74e8-45f6-88d6-be6b26012461 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lazy-loading 'services' on Instance uuid a7814c9b-5724-412b-9a58-99504793c39e {{(pid=120649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 30 19:39:39.282542 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-91a60cbb-74e8-45f6-88d6-be6b26012461 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e/os-volume_attachments/7547b3b3-3632-4309-9bcd-db9f1095a433" status: 202 len: 0 microversion: 2.1 time: 0.165627 Sep 30 19:39:39.283121 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 521/1000] 10.222.0.17 () {58 vars in 1416 bytes} [Fri Sep 30 19:39:39 2022] DELETE /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e/os-volume_attachments/7547b3b3-3632-4309-9bcd-db9f1095a433 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 30 19:39:40.455257 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-9832f686-f7c7-47ac-81ef-6d24fbd1de77 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:39:40.457483 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-9832f686-f7c7-47ac-81ef-6d24fbd1de77 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: a7814c9b-5724-412b-9a58-99504793c39e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:39:40.463628 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9832f686-f7c7-47ac-81ef-6d24fbd1de77 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:40.464107 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9832f686-f7c7-47ac-81ef-6d24fbd1de77 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:40.464573 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9832f686-f7c7-47ac-81ef-6d24fbd1de77 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:40.465252 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9832f686-f7c7-47ac-81ef-6d24fbd1de77 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:40.465731 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9832f686-f7c7-47ac-81ef-6d24fbd1de77 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:40.466154 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9832f686-f7c7-47ac-81ef-6d24fbd1de77 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:40.494946 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-9832f686-f7c7-47ac-81ef-6d24fbd1de77 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043988 Sep 30 19:39:40.495426 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 480/1001] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 30 19:39:40 2022] GET /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 30 19:39:40.609326 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-e7de0e13-a9a4-4eb4-9101-c090b95fe7de tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:39:40.611706 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-e7de0e13-a9a4-4eb4-9101-c090b95fe7de tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: a7814c9b-5724-412b-9a58-99504793c39e] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:39:40.617808 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e7de0e13-a9a4-4eb4-9101-c090b95fe7de tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:40.618297 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e7de0e13-a9a4-4eb4-9101-c090b95fe7de tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:40.618741 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e7de0e13-a9a4-4eb4-9101-c090b95fe7de tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:40.619434 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e7de0e13-a9a4-4eb4-9101-c090b95fe7de tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:40.619897 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e7de0e13-a9a4-4eb4-9101-c090b95fe7de tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:40.620333 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e7de0e13-a9a4-4eb4-9101-c090b95fe7de tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:40.649511 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-e7de0e13-a9a4-4eb4-9101-c090b95fe7de tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044930 Sep 30 19:39:40.650054 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 522/1002] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 30 19:39:40 2022] GET /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 30 19:39:40.712123 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-8c642638-94fa-46e2-8146-80914206245c tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:39:40.712656 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-8c642638-94fa-46e2-8146-80914206245c tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: a7814c9b-5724-412b-9a58-99504793c39e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:39:40.718587 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8c642638-94fa-46e2-8146-80914206245c tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:40.719073 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8c642638-94fa-46e2-8146-80914206245c tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:40.719511 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8c642638-94fa-46e2-8146-80914206245c tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:40.720211 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8c642638-94fa-46e2-8146-80914206245c tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:40.720685 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8c642638-94fa-46e2-8146-80914206245c tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:40.721117 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8c642638-94fa-46e2-8146-80914206245c tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:40.745388 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-8c642638-94fa-46e2-8146-80914206245c tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: a7814c9b-5724-412b-9a58-99504793c39e] Going to try to terminate instance {{(pid=120648) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 30 19:39:40.819041 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-8c642638-94fa-46e2-8146-80914206245c tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e" status: 204 len: 0 microversion: 2.1 time: 0.110399 Sep 30 19:39:40.819611 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 481/1003] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 30 19:39:40 2022] DELETE /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 30 19:39:40.827903 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-4b44efe7-06d0-4ba0-970c-4bd3f07aa3ce tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:39:40.828522 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-4b44efe7-06d0-4ba0-970c-4bd3f07aa3ce tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: a7814c9b-5724-412b-9a58-99504793c39e] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:39:40.835046 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4b44efe7-06d0-4ba0-970c-4bd3f07aa3ce tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:40.835527 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4b44efe7-06d0-4ba0-970c-4bd3f07aa3ce tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:40.835958 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4b44efe7-06d0-4ba0-970c-4bd3f07aa3ce tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:40.836675 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4b44efe7-06d0-4ba0-970c-4bd3f07aa3ce tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:40.837127 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4b44efe7-06d0-4ba0-970c-4bd3f07aa3ce tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:40.837568 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4b44efe7-06d0-4ba0-970c-4bd3f07aa3ce tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:40.966337 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-4b44efe7-06d0-4ba0-970c-4bd3f07aa3ce tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:40.974050 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-4b44efe7-06d0-4ba0-970c-4bd3f07aa3ce tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e" status: 200 len: 1673 microversion: 2.1 time: 0.150029 Sep 30 19:39:40.974616 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 523/1004] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:39:40 2022] GET /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e => generated 1673 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:39:41.997806 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-9bdcce9a-ee73-4d7b-8e2d-d86412c175cc tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:39:41.998509 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-9bdcce9a-ee73-4d7b-8e2d-d86412c175cc tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: a7814c9b-5724-412b-9a58-99504793c39e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:39:42.004874 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9bdcce9a-ee73-4d7b-8e2d-d86412c175cc tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:42.005360 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9bdcce9a-ee73-4d7b-8e2d-d86412c175cc tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:42.005799 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9bdcce9a-ee73-4d7b-8e2d-d86412c175cc tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:42.006520 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9bdcce9a-ee73-4d7b-8e2d-d86412c175cc tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:42.006981 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9bdcce9a-ee73-4d7b-8e2d-d86412c175cc tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:42.007411 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9bdcce9a-ee73-4d7b-8e2d-d86412c175cc tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:42.132798 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-9bdcce9a-ee73-4d7b-8e2d-d86412c175cc tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:42.140406 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-9bdcce9a-ee73-4d7b-8e2d-d86412c175cc tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e" status: 200 len: 1673 microversion: 2.1 time: 0.146879 Sep 30 19:39:42.140971 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 482/1005] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:39:41 2022] GET /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e => generated 1673 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:39:43.164900 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-52b1b519-05a3-46d6-91cf-77eeb4864210 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:39:43.165487 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-52b1b519-05a3-46d6-91cf-77eeb4864210 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: a7814c9b-5724-412b-9a58-99504793c39e] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:39:43.171782 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-52b1b519-05a3-46d6-91cf-77eeb4864210 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:43.172265 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-52b1b519-05a3-46d6-91cf-77eeb4864210 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:43.173400 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-52b1b519-05a3-46d6-91cf-77eeb4864210 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:43.174091 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-52b1b519-05a3-46d6-91cf-77eeb4864210 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:43.174552 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-52b1b519-05a3-46d6-91cf-77eeb4864210 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:43.174978 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-52b1b519-05a3-46d6-91cf-77eeb4864210 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:43.301654 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-52b1b519-05a3-46d6-91cf-77eeb4864210 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:43.309382 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-52b1b519-05a3-46d6-91cf-77eeb4864210 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e" status: 200 len: 1673 microversion: 2.1 time: 0.148354 Sep 30 19:39:43.309944 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 524/1006] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:39:43 2022] GET /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e => generated 1673 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:39:44.132988 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-2737e8bd-f6da-4643-b65d-e97016a305f9 req-7f5c9d32-9586-4af3-a781-6328348a9b09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7814c9b-5724-412b-9a58-99504793c39e", "name": "network-vif-deleted", "tag": "0b4dd313-eeeb-4b83-8c51-6bb29d093b1e"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:39:44.143528 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-2737e8bd-f6da-4643-b65d-e97016a305f9 req-7f5c9d32-9586-4af3-a781-6328348a9b09 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:44.144016 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-2737e8bd-f6da-4643-b65d-e97016a305f9 req-7f5c9d32-9586-4af3-a781-6328348a9b09 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:44.144477 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-2737e8bd-f6da-4643-b65d-e97016a305f9 req-7f5c9d32-9586-4af3-a781-6328348a9b09 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:44.157299 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-2737e8bd-f6da-4643-b65d-e97016a305f9 req-7f5c9d32-9586-4af3-a781-6328348a9b09 service nova] Creating event network-vif-deleted:0b4dd313-eeeb-4b83-8c51-6bb29d093b1e for instance a7814c9b-5724-412b-9a58-99504793c39e on hv-cinder-86001 Sep 30 19:39:44.162901 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-2737e8bd-f6da-4643-b65d-e97016a305f9 req-7f5c9d32-9586-4af3-a781-6328348a9b09 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033442 Sep 30 19:39:44.163805 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 483/1007] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 30 19:39:44.332908 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-1e03bc69-a58b-42bf-9870-fc3371a4651b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:39:44.333648 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-1e03bc69-a58b-42bf-9870-fc3371a4651b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: a7814c9b-5724-412b-9a58-99504793c39e] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:39:44.345835 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1e03bc69-a58b-42bf-9870-fc3371a4651b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:44.346376 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1e03bc69-a58b-42bf-9870-fc3371a4651b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:44.346976 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1e03bc69-a58b-42bf-9870-fc3371a4651b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:44.347695 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1e03bc69-a58b-42bf-9870-fc3371a4651b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:44.348173 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1e03bc69-a58b-42bf-9870-fc3371a4651b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:44.348643 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1e03bc69-a58b-42bf-9870-fc3371a4651b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:44.381188 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1e03bc69-a58b-42bf-9870-fc3371a4651b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:44.381680 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1e03bc69-a58b-42bf-9870-fc3371a4651b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:44.382181 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1e03bc69-a58b-42bf-9870-fc3371a4651b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:44.382643 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.objects.instance [None req-1e03bc69-a58b-42bf-9870-fc3371a4651b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lazy-loading 'fault' on Instance uuid a7814c9b-5724-412b-9a58-99504793c39e {{(pid=120649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 30 19:39:44.432308 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-1e03bc69-a58b-42bf-9870-fc3371a4651b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397314cdd52409c920071ae009516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5815ead619491680fb44af178e9cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:39:44.440437 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-1e03bc69-a58b-42bf-9870-fc3371a4651b tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e" status: 200 len: 1327 microversion: 2.1 time: 0.111679 Sep 30 19:39:44.455792 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 525/1008] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:39:44 2022] GET /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e => generated 1327 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:39:45.464082 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-f9820186-80ca-46fe-ac0d-379fed5cf6e8 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:39:45.464820 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-f9820186-80ca-46fe-ac0d-379fed5cf6e8 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: a7814c9b-5724-412b-9a58-99504793c39e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:39:45.470872 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f9820186-80ca-46fe-ac0d-379fed5cf6e8 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:45.471357 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f9820186-80ca-46fe-ac0d-379fed5cf6e8 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:45.471794 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f9820186-80ca-46fe-ac0d-379fed5cf6e8 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:45.472519 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f9820186-80ca-46fe-ac0d-379fed5cf6e8 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:45.473006 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f9820186-80ca-46fe-ac0d-379fed5cf6e8 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:45.473433 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f9820186-80ca-46fe-ac0d-379fed5cf6e8 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:45.486377 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.wsgi [None req-f9820186-80ca-46fe-ac0d-379fed5cf6e8 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] HTTP exception thrown: Instance a7814c9b-5724-412b-9a58-99504793c39e could not be found. Sep 30 19:39:45.487902 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-f9820186-80ca-46fe-ac0d-379fed5cf6e8 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Request method failure captured: Sep 30 19:39:45.487902 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: request: GET /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e HTTP/1.1 Sep 30 19:39:45.487902 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 30 19:39:45.487902 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 30 19:39:45.487902 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Connection: close Sep 30 19:39:45.487902 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Length: 0 Sep 30 19:39:45.487902 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 30 19:39:45.487902 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Host: 10.222.0.17 Sep 30 19:39:45.487902 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 30 19:39:45.487902 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 30 19:39:45.487902 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjN0OLsm0Q7d1hmxK2ta6SW3ynZ14vpctXWB_vXbqF72it1_tuEuwkY8C7Dgu7_C1glQATQugNpziI_G2R1zPuaBX-l-_Zr75E-WgD7iKGfdhvasTlBqZOY00RXaw3n2dNzTEAy2KbqUHrt8NIeEcg8zeQ-BWzmyFqe71VGZiEhVVhNSo Sep 30 19:39:45.487902 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 30 19:39:45.487902 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 30 19:39:45.487902 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 30 19:39:45.487902 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 30 19:39:45.487902 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 30 19:39:45.487902 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 30 19:39:45.487902 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Id: ac5815ead619491680fb44af178e9cc0 Sep 30 19:39:45.487902 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-AttachVolumeTestJSON-1632686379 Sep 30 19:39:45.487902 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 30 19:39:45.487902 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 30 19:39:45.489613 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ac5815ead619491680fb44af178e9cc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ac5815ead619491680fb44af178e9cc0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ac5815ead619491680fb44af178e9cc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ac5815ead619491680fb44af178e9cc0"}]}] Sep 30 19:39:45.489613 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-AttachVolumeTestJSON-1632686379 Sep 30 19:39:45.489613 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Id: ac5815ead619491680fb44af178e9cc0 Sep 30 19:39:45.489613 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1632686379 Sep 30 19:39:45.489613 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User: tempest-AttachVolumeTestJSON-1632686379-project Sep 30 19:39:45.489613 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 30 19:39:45.489613 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 30 19:39:45.489613 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Id: a397314cdd52409c920071ae009516af Sep 30 19:39:45.489613 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-AttachVolumeTestJSON-1632686379-project Sep 30 19:39:45.489613 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: method: > Sep 30 19:39:45.489613 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: exception: Instance a7814c9b-5724-412b-9a58-99504793c39e could not be found. Sep 30 19:39:45.489613 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: action_args: {'id': 'a7814c9b-5724-412b-9a58-99504793c39e'} Sep 30 19:39:45.490563 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:39:45.490563 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:39:45.490563 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 30 19:39:45.490563 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 30 19:39:45.490563 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 30 19:39:45.490563 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 30 19:39:45.490563 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 30 19:39:45.490563 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 30 19:39:45.490563 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 30 19:39:45.490563 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 30 19:39:45.490563 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7814c9b-5724-412b-9a58-99504793c39e could not be found. Sep 30 19:39:45.490563 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:39:45.490563 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:39:45.490563 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:39:45.490563 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:39:45.490563 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:39:45.490563 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:39:45.490563 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:39:45.490563 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:39:45.490563 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:39:45.492187 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:39:45.492187 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 30 19:39:45.492187 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 30 19:39:45.492187 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 30 19:39:45.492187 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 30 19:39:45.492187 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 30 19:39:45.492187 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 30 19:39:45.492187 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7814c9b-5724-412b-9a58-99504793c39e could not be found. Sep 30 19:39:45.492187 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:39:45.492187 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:39:45.492187 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:39:45.492187 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:39:45.492187 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:39:45.492187 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:39:45.492187 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:39:45.492187 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:39:45.492187 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7814c9b-5724-412b-9a58-99504793c39e could not be found. Sep 30 19:39:45.492187 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:39:45.493586 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-f9820186-80ca-46fe-ac0d-379fed5cf6e8 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Returning 404 to user: Instance a7814c9b-5724-412b-9a58-99504793c39e could not be found. {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:39:45.493586 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-f9820186-80ca-46fe-ac0d-379fed5cf6e8 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e" status: 404 len: 111 microversion: 2.1 time: 0.029932 Sep 30 19:39:45.493586 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 484/1009] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:39:45 2022] GET /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 30 19:39:45.497985 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-b0763daa-c96e-4865-a5e8-97f817c34cd6 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '.version_select at 0x7f621eb404c0>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:39:45.517421 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-b0763daa-c96e-4865-a5e8-97f817c34cd6 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-662032815" status: 202 len: 0 microversion: 2.1 time: 0.023159 Sep 30 19:39:45.517964 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 526/1010] 10.222.0.17 () {58 vars in 1218 bytes} [Fri Sep 30 19:39:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-662032815 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 30 19:39:48.365335 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-0534a93f-1d13-4713-b598-65d5a675a8f5 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:39:48.365875 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-0534a93f-1d13-4713-b598-65d5a675a8f5 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: a7814c9b-5724-412b-9a58-99504793c39e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:39:48.368479 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:39:48.374137 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0534a93f-1d13-4713-b598-65d5a675a8f5 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:48.374632 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0534a93f-1d13-4713-b598-65d5a675a8f5 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:48.375074 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0534a93f-1d13-4713-b598-65d5a675a8f5 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:48.375780 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0534a93f-1d13-4713-b598-65d5a675a8f5 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:48.376239 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0534a93f-1d13-4713-b598-65d5a675a8f5 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:48.376716 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0534a93f-1d13-4713-b598-65d5a675a8f5 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:48.381168 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:39:48.391851 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.wsgi [None req-0534a93f-1d13-4713-b598-65d5a675a8f5 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] HTTP exception thrown: Instance a7814c9b-5724-412b-9a58-99504793c39e could not be found. Sep 30 19:39:48.393535 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-0534a93f-1d13-4713-b598-65d5a675a8f5 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Request method failure captured: Sep 30 19:39:48.393535 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: request: DELETE /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e HTTP/1.1 Sep 30 19:39:48.393535 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 30 19:39:48.393535 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 30 19:39:48.393535 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Connection: close Sep 30 19:39:48.393535 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Length: 0 Sep 30 19:39:48.393535 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 30 19:39:48.393535 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Host: 10.222.0.17 Sep 30 19:39:48.393535 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 30 19:39:48.393535 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 30 19:39:48.393535 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjN0OLsm0Q7d1hmxK2ta6SW3ynZ14vpctXWB_vXbqF72it1_tuEuwkY8C7Dgu7_C1glQATQugNpziI_G2R1zPuaBX-l-_Zr75E-WgD7iKGfdhvasTlBqZOY00RXaw3n2dNzTEAy2KbqUHrt8NIeEcg8zeQ-BWzmyFqe71VGZiEhVVhNSo Sep 30 19:39:48.393535 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 30 19:39:48.393535 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 30 19:39:48.393535 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 30 19:39:48.393535 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 30 19:39:48.393535 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 30 19:39:48.393535 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 30 19:39:48.393535 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Id: ac5815ead619491680fb44af178e9cc0 Sep 30 19:39:48.393535 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-AttachVolumeTestJSON-1632686379 Sep 30 19:39:48.393535 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 30 19:39:48.393535 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 30 19:39:48.394997 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ac5815ead619491680fb44af178e9cc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ac5815ead619491680fb44af178e9cc0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ac5815ead619491680fb44af178e9cc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ac5815ead619491680fb44af178e9cc0"}]}] Sep 30 19:39:48.394997 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-AttachVolumeTestJSON-1632686379 Sep 30 19:39:48.394997 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Id: ac5815ead619491680fb44af178e9cc0 Sep 30 19:39:48.394997 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1632686379 Sep 30 19:39:48.394997 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User: tempest-AttachVolumeTestJSON-1632686379-project Sep 30 19:39:48.394997 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 30 19:39:48.394997 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 30 19:39:48.394997 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Id: a397314cdd52409c920071ae009516af Sep 30 19:39:48.394997 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-AttachVolumeTestJSON-1632686379-project Sep 30 19:39:48.394997 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: method: > Sep 30 19:39:48.394997 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: exception: Instance a7814c9b-5724-412b-9a58-99504793c39e could not be found. Sep 30 19:39:48.394997 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: action_args: {'id': 'a7814c9b-5724-412b-9a58-99504793c39e'} Sep 30 19:39:48.395820 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:39:48.395820 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:39:48.395820 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 30 19:39:48.395820 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 30 19:39:48.395820 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 30 19:39:48.395820 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 30 19:39:48.395820 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 30 19:39:48.395820 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 30 19:39:48.395820 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 30 19:39:48.395820 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 30 19:39:48.395820 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7814c9b-5724-412b-9a58-99504793c39e could not be found. Sep 30 19:39:48.395820 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:39:48.395820 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:39:48.395820 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:39:48.395820 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:39:48.395820 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:39:48.395820 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:39:48.395820 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:39:48.395820 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:39:48.395820 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:39:48.397105 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:39:48.397105 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 30 19:39:48.397105 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 30 19:39:48.397105 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 30 19:39:48.397105 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 30 19:39:48.397105 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 30 19:39:48.397105 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 30 19:39:48.397105 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 30 19:39:48.397105 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 30 19:39:48.397105 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7814c9b-5724-412b-9a58-99504793c39e could not be found. Sep 30 19:39:48.397105 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:39:48.397105 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:39:48.397105 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:39:48.397105 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:39:48.397105 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:39:48.397105 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:39:48.397105 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:39:48.397105 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:39:48.397105 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7814c9b-5724-412b-9a58-99504793c39e could not be found. Sep 30 19:39:48.397105 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:39:48.398379 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-0534a93f-1d13-4713-b598-65d5a675a8f5 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Returning 404 to user: Instance a7814c9b-5724-412b-9a58-99504793c39e could not be found. {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:39:48.398379 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-0534a93f-1d13-4713-b598-65d5a675a8f5 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e" status: 404 len: 111 microversion: 2.1 time: 0.033879 Sep 30 19:39:48.398379 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 485/1011] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 30 19:39:48 2022] DELETE /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 30 19:39:48.404665 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-b67a9449-affe-4fe8-843d-9912987c0eec tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:39:48.405280 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-b67a9449-affe-4fe8-843d-9912987c0eec tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: a7814c9b-5724-412b-9a58-99504793c39e] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:39:48.412086 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-d287d236-8b6e-438e-bed1-90de844ab63a tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:39:48.412601 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-d287d236-8b6e-438e-bed1-90de844ab63a tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: 42acb210-bef2-4e45-9b48-ed1c75fdf191] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:39:48.413189 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b67a9449-affe-4fe8-843d-9912987c0eec tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:48.413731 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b67a9449-affe-4fe8-843d-9912987c0eec tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:48.414178 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b67a9449-affe-4fe8-843d-9912987c0eec tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:48.414872 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b67a9449-affe-4fe8-843d-9912987c0eec tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:48.415327 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b67a9449-affe-4fe8-843d-9912987c0eec tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:48.415754 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b67a9449-affe-4fe8-843d-9912987c0eec tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:48.418920 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:39:48.420034 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d287d236-8b6e-438e-bed1-90de844ab63a tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:48.421775 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d287d236-8b6e-438e-bed1-90de844ab63a tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:48.421775 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d287d236-8b6e-438e-bed1-90de844ab63a tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:48.421775 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d287d236-8b6e-438e-bed1-90de844ab63a tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:48.422958 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d287d236-8b6e-438e-bed1-90de844ab63a tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:48.423578 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d287d236-8b6e-438e-bed1-90de844ab63a tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:48.431331 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.wsgi [None req-b67a9449-affe-4fe8-843d-9912987c0eec tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] HTTP exception thrown: Instance a7814c9b-5724-412b-9a58-99504793c39e could not be found. Sep 30 19:39:48.432991 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-b67a9449-affe-4fe8-843d-9912987c0eec tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Request method failure captured: Sep 30 19:39:48.432991 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: request: GET /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e HTTP/1.1 Sep 30 19:39:48.432991 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Accept: application/json Sep 30 19:39:48.432991 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Accept-Encoding: identity Sep 30 19:39:48.432991 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Connection: close Sep 30 19:39:48.432991 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Content-Length: 0 Sep 30 19:39:48.432991 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Content-Type: application/json Sep 30 19:39:48.432991 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Host: 10.222.0.17 Sep 30 19:39:48.432991 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Openstack-System-Scope: None Sep 30 19:39:48.432991 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: User-Agent: python-urllib3/1.26.12 Sep 30 19:39:48.432991 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Auth-Token: gAAAAABjN0OLsm0Q7d1hmxK2ta6SW3ynZ14vpctXWB_vXbqF72it1_tuEuwkY8C7Dgu7_C1glQATQugNpziI_G2R1zPuaBX-l-_Zr75E-WgD7iKGfdhvasTlBqZOY00RXaw3n2dNzTEAy2KbqUHrt8NIeEcg8zeQ-BWzmyFqe71VGZiEhVVhNSo Sep 30 19:39:48.432991 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Domain-Id: None Sep 30 19:39:48.432991 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Domain-Name: None Sep 30 19:39:48.432991 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Identity-Status: Confirmed Sep 30 19:39:48.432991 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Is-Admin-Project: True Sep 30 19:39:48.432991 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Domain-Id: default Sep 30 19:39:48.432991 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Domain-Name: Default Sep 30 19:39:48.432991 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Id: ac5815ead619491680fb44af178e9cc0 Sep 30 19:39:48.432991 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Name: tempest-AttachVolumeTestJSON-1632686379 Sep 30 19:39:48.432991 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Role: member,reader Sep 30 19:39:48.432991 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Roles: member,reader Sep 30 19:39:48.434576 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ac5815ead619491680fb44af178e9cc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ac5815ead619491680fb44af178e9cc0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ac5815ead619491680fb44af178e9cc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ac5815ead619491680fb44af178e9cc0"}]}] Sep 30 19:39:48.434576 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant: tempest-AttachVolumeTestJSON-1632686379 Sep 30 19:39:48.434576 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant-Id: ac5815ead619491680fb44af178e9cc0 Sep 30 19:39:48.434576 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1632686379 Sep 30 19:39:48.434576 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User: tempest-AttachVolumeTestJSON-1632686379-project Sep 30 19:39:48.434576 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Domain-Id: default Sep 30 19:39:48.434576 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Domain-Name: Default Sep 30 19:39:48.434576 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Id: a397314cdd52409c920071ae009516af Sep 30 19:39:48.434576 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Name: tempest-AttachVolumeTestJSON-1632686379-project Sep 30 19:39:48.434576 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: method: > Sep 30 19:39:48.434576 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: exception: Instance a7814c9b-5724-412b-9a58-99504793c39e could not be found. Sep 30 19:39:48.434576 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: action_args: {'id': 'a7814c9b-5724-412b-9a58-99504793c39e'} Sep 30 19:39:48.438749 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:39:48.438749 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:39:48.438749 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 30 19:39:48.438749 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 30 19:39:48.438749 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 30 19:39:48.438749 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 30 19:39:48.438749 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 30 19:39:48.438749 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 30 19:39:48.438749 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 30 19:39:48.438749 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 30 19:39:48.438749 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7814c9b-5724-412b-9a58-99504793c39e could not be found. Sep 30 19:39:48.438749 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:39:48.438749 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:39:48.438749 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:39:48.438749 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:39:48.438749 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:39:48.438749 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:39:48.438749 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:39:48.438749 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:39:48.438749 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:39:48.440331 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:39:48.440331 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 30 19:39:48.440331 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 30 19:39:48.440331 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 30 19:39:48.440331 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 30 19:39:48.440331 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 30 19:39:48.440331 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 30 19:39:48.440331 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7814c9b-5724-412b-9a58-99504793c39e could not be found. Sep 30 19:39:48.440331 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:39:48.440331 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:39:48.440331 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:39:48.440331 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:39:48.440331 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:39:48.440331 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:39:48.440331 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:39:48.440331 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:39:48.440331 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7814c9b-5724-412b-9a58-99504793c39e could not be found. Sep 30 19:39:48.440331 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:39:48.442170 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-b67a9449-affe-4fe8-843d-9912987c0eec tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Returning 404 to user: Instance a7814c9b-5724-412b-9a58-99504793c39e could not be found. {{(pid=120649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:39:48.442170 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-b67a9449-affe-4fe8-843d-9912987c0eec tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e" status: 404 len: 111 microversion: 2.1 time: 0.034536 Sep 30 19:39:48.442170 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 527/1012] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:39:48 2022] GET /compute/v2.1/servers/a7814c9b-5724-412b-9a58-99504793c39e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 30 19:39:48.447170 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-d287d236-8b6e-438e-bed1-90de844ab63a tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191/ips" status: 200 len: 149 microversion: 2.1 time: 0.039033 Sep 30 19:39:48.447795 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 486/1013] 10.222.0.17 () {58 vars in 1248 bytes} [Fri Sep 30 19:39:48 2022] GET /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 30 19:39:49.578273 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-0f12c080-2581-4ea8-97ef-2c5da0857fc5 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:39:49.578815 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-0f12c080-2581-4ea8-97ef-2c5da0857fc5 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:39:49.585194 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0f12c080-2581-4ea8-97ef-2c5da0857fc5 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:49.585685 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0f12c080-2581-4ea8-97ef-2c5da0857fc5 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:49.586128 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0f12c080-2581-4ea8-97ef-2c5da0857fc5 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:49.586829 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0f12c080-2581-4ea8-97ef-2c5da0857fc5 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:49.587292 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0f12c080-2581-4ea8-97ef-2c5da0857fc5 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:49.587724 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0f12c080-2581-4ea8-97ef-2c5da0857fc5 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:49.600722 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.wsgi [None req-0f12c080-2581-4ea8-97ef-2c5da0857fc5 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] HTTP exception thrown: Instance 304c3216-3e08-4ea0-9ca4-ab7d78a952a9 could not be found. Sep 30 19:39:49.602246 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-0f12c080-2581-4ea8-97ef-2c5da0857fc5 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Request method failure captured: Sep 30 19:39:49.602246 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: request: DELETE /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 HTTP/1.1 Sep 30 19:39:49.602246 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Accept: application/json Sep 30 19:39:49.602246 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Accept-Encoding: identity Sep 30 19:39:49.602246 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Connection: close Sep 30 19:39:49.602246 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Content-Length: 0 Sep 30 19:39:49.602246 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Content-Type: application/json Sep 30 19:39:49.602246 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Host: 10.222.0.17 Sep 30 19:39:49.602246 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Openstack-System-Scope: None Sep 30 19:39:49.602246 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: User-Agent: python-urllib3/1.26.12 Sep 30 19:39:49.602246 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Auth-Token: gAAAAABjN0OLsm0Q7d1hmxK2ta6SW3ynZ14vpctXWB_vXbqF72it1_tuEuwkY8C7Dgu7_C1glQATQugNpziI_G2R1zPuaBX-l-_Zr75E-WgD7iKGfdhvasTlBqZOY00RXaw3n2dNzTEAy2KbqUHrt8NIeEcg8zeQ-BWzmyFqe71VGZiEhVVhNSo Sep 30 19:39:49.602246 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Domain-Id: None Sep 30 19:39:49.602246 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Domain-Name: None Sep 30 19:39:49.602246 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Identity-Status: Confirmed Sep 30 19:39:49.602246 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Is-Admin-Project: True Sep 30 19:39:49.602246 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Domain-Id: default Sep 30 19:39:49.602246 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Domain-Name: Default Sep 30 19:39:49.602246 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Id: ac5815ead619491680fb44af178e9cc0 Sep 30 19:39:49.602246 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Name: tempest-AttachVolumeTestJSON-1632686379 Sep 30 19:39:49.602246 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Role: member,reader Sep 30 19:39:49.602246 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Roles: member,reader Sep 30 19:39:49.603863 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ac5815ead619491680fb44af178e9cc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ac5815ead619491680fb44af178e9cc0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ac5815ead619491680fb44af178e9cc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ac5815ead619491680fb44af178e9cc0"}]}] Sep 30 19:39:49.603863 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant: tempest-AttachVolumeTestJSON-1632686379 Sep 30 19:39:49.603863 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant-Id: ac5815ead619491680fb44af178e9cc0 Sep 30 19:39:49.603863 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1632686379 Sep 30 19:39:49.603863 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User: tempest-AttachVolumeTestJSON-1632686379-project Sep 30 19:39:49.603863 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Domain-Id: default Sep 30 19:39:49.603863 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Domain-Name: Default Sep 30 19:39:49.603863 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Id: a397314cdd52409c920071ae009516af Sep 30 19:39:49.603863 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Name: tempest-AttachVolumeTestJSON-1632686379-project Sep 30 19:39:49.603863 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: method: > Sep 30 19:39:49.603863 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: exception: Instance 304c3216-3e08-4ea0-9ca4-ab7d78a952a9 could not be found. Sep 30 19:39:49.603863 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: action_args: {'id': '304c3216-3e08-4ea0-9ca4-ab7d78a952a9'} Sep 30 19:39:49.604996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:39:49.604996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:39:49.604996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 30 19:39:49.604996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 30 19:39:49.604996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 30 19:39:49.604996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 30 19:39:49.604996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 30 19:39:49.604996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 30 19:39:49.604996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 30 19:39:49.604996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 30 19:39:49.604996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 304c3216-3e08-4ea0-9ca4-ab7d78a952a9 could not be found. Sep 30 19:39:49.604996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:39:49.604996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:39:49.604996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:39:49.604996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:39:49.604996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:39:49.604996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:39:49.604996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:39:49.604996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:39:49.604996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:39:49.606474 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:39:49.606474 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 30 19:39:49.606474 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 30 19:39:49.606474 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 30 19:39:49.606474 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 30 19:39:49.606474 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 30 19:39:49.606474 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 30 19:39:49.606474 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 30 19:39:49.606474 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 30 19:39:49.606474 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 304c3216-3e08-4ea0-9ca4-ab7d78a952a9 could not be found. Sep 30 19:39:49.606474 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:39:49.606474 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:39:49.606474 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:39:49.606474 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:39:49.606474 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:39:49.606474 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:39:49.606474 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:39:49.606474 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:39:49.606474 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 304c3216-3e08-4ea0-9ca4-ab7d78a952a9 could not be found. Sep 30 19:39:49.606474 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:39:49.608001 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-0f12c080-2581-4ea8-97ef-2c5da0857fc5 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Returning 404 to user: Instance 304c3216-3e08-4ea0-9ca4-ab7d78a952a9 could not be found. {{(pid=120649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:39:49.608001 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-0f12c080-2581-4ea8-97ef-2c5da0857fc5 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "DELETE /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 404 len: 111 microversion: 2.1 time: 0.029340 Sep 30 19:39:49.608001 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 528/1014] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 30 19:39:49 2022] DELETE /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 30 19:39:49.612191 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-3392af3b-59da-4f8e-a228-2abcb7953eb9 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:39:49.612829 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-3392af3b-59da-4f8e-a228-2abcb7953eb9 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] [instance: 304c3216-3e08-4ea0-9ca4-ab7d78a952a9] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:39:49.619249 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3392af3b-59da-4f8e-a228-2abcb7953eb9 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:49.619727 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3392af3b-59da-4f8e-a228-2abcb7953eb9 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:49.620164 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3392af3b-59da-4f8e-a228-2abcb7953eb9 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:49.620886 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3392af3b-59da-4f8e-a228-2abcb7953eb9 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:49.621345 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3392af3b-59da-4f8e-a228-2abcb7953eb9 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:49.621773 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3392af3b-59da-4f8e-a228-2abcb7953eb9 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:49.637779 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.wsgi [None req-3392af3b-59da-4f8e-a228-2abcb7953eb9 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] HTTP exception thrown: Instance 304c3216-3e08-4ea0-9ca4-ab7d78a952a9 could not be found. Sep 30 19:39:49.640820 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-3392af3b-59da-4f8e-a228-2abcb7953eb9 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Request method failure captured: Sep 30 19:39:49.640820 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: request: GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 HTTP/1.1 Sep 30 19:39:49.640820 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 30 19:39:49.640820 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 30 19:39:49.640820 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Connection: close Sep 30 19:39:49.640820 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Length: 0 Sep 30 19:39:49.640820 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 30 19:39:49.640820 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Host: 10.222.0.17 Sep 30 19:39:49.640820 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 30 19:39:49.640820 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 30 19:39:49.640820 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjN0OLsm0Q7d1hmxK2ta6SW3ynZ14vpctXWB_vXbqF72it1_tuEuwkY8C7Dgu7_C1glQATQugNpziI_G2R1zPuaBX-l-_Zr75E-WgD7iKGfdhvasTlBqZOY00RXaw3n2dNzTEAy2KbqUHrt8NIeEcg8zeQ-BWzmyFqe71VGZiEhVVhNSo Sep 30 19:39:49.640820 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 30 19:39:49.640820 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 30 19:39:49.640820 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 30 19:39:49.640820 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 30 19:39:49.640820 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 30 19:39:49.640820 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 30 19:39:49.640820 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Id: ac5815ead619491680fb44af178e9cc0 Sep 30 19:39:49.640820 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-AttachVolumeTestJSON-1632686379 Sep 30 19:39:49.640820 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 30 19:39:49.640820 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 30 19:39:49.642424 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ac5815ead619491680fb44af178e9cc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ac5815ead619491680fb44af178e9cc0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ac5815ead619491680fb44af178e9cc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ac5815ead619491680fb44af178e9cc0"}]}] Sep 30 19:39:49.642424 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-AttachVolumeTestJSON-1632686379 Sep 30 19:39:49.642424 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Id: ac5815ead619491680fb44af178e9cc0 Sep 30 19:39:49.642424 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1632686379 Sep 30 19:39:49.642424 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User: tempest-AttachVolumeTestJSON-1632686379-project Sep 30 19:39:49.642424 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 30 19:39:49.642424 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 30 19:39:49.642424 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Id: a397314cdd52409c920071ae009516af Sep 30 19:39:49.642424 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-AttachVolumeTestJSON-1632686379-project Sep 30 19:39:49.642424 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: method: > Sep 30 19:39:49.642424 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: exception: Instance 304c3216-3e08-4ea0-9ca4-ab7d78a952a9 could not be found. Sep 30 19:39:49.642424 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: action_args: {'id': '304c3216-3e08-4ea0-9ca4-ab7d78a952a9'} Sep 30 19:39:49.643418 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:39:49.643418 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:39:49.643418 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 30 19:39:49.643418 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 30 19:39:49.643418 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 30 19:39:49.643418 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 30 19:39:49.643418 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 30 19:39:49.643418 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 30 19:39:49.643418 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 30 19:39:49.643418 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 30 19:39:49.643418 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 304c3216-3e08-4ea0-9ca4-ab7d78a952a9 could not be found. Sep 30 19:39:49.643418 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:39:49.643418 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:39:49.643418 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:39:49.643418 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:39:49.643418 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:39:49.643418 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:39:49.643418 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:39:49.643418 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:39:49.643418 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:39:49.644945 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:39:49.644945 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 30 19:39:49.644945 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 30 19:39:49.644945 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 30 19:39:49.644945 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 30 19:39:49.644945 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 30 19:39:49.644945 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 30 19:39:49.644945 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 304c3216-3e08-4ea0-9ca4-ab7d78a952a9 could not be found. Sep 30 19:39:49.644945 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:39:49.644945 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:39:49.644945 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:39:49.644945 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:39:49.644945 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:39:49.644945 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:39:49.644945 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:39:49.644945 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:39:49.644945 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 304c3216-3e08-4ea0-9ca4-ab7d78a952a9 could not be found. Sep 30 19:39:49.644945 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:39:49.646263 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-3392af3b-59da-4f8e-a228-2abcb7953eb9 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] Returning 404 to user: Instance 304c3216-3e08-4ea0-9ca4-ab7d78a952a9 could not be found. {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:39:49.646263 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-3392af3b-59da-4f8e-a228-2abcb7953eb9 tempest-AttachVolumeTestJSON-1632686379 tempest-AttachVolumeTestJSON-1632686379-project] 10.222.0.17 "GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9" status: 404 len: 111 microversion: 2.1 time: 0.034886 Sep 30 19:39:49.646263 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 487/1015] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:39:49 2022] GET /compute/v2.1/servers/304c3216-3e08-4ea0-9ca4-ab7d78a952a9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 30 19:39:49.793326 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-46b962f3-62fd-4a7d-a413-229c623a7166 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fca66295-f727-4ee7-907f-40579a44092f"}} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:39:49.795719 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-46b962f3-62fd-4a7d-a413-229c623a7166 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: 42acb210-bef2-4e45-9b48-ed1c75fdf191] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:39:49.802500 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-46b962f3-62fd-4a7d-a413-229c623a7166 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:49.802990 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-46b962f3-62fd-4a7d-a413-229c623a7166 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:49.803423 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-46b962f3-62fd-4a7d-a413-229c623a7166 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:49.804137 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-46b962f3-62fd-4a7d-a413-229c623a7166 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:49.804619 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-46b962f3-62fd-4a7d-a413-229c623a7166 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:49.805051 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-46b962f3-62fd-4a7d-a413-229c623a7166 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:50.088095 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-46b962f3-62fd-4a7d-a413-229c623a7166 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "POST /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298571 Sep 30 19:39:50.088756 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 529/1016] 10.222.0.17 () {60 vars in 1323 bytes} [Fri Sep 30 19:39:49 2022] POST /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191/os-volume_attachments => generated 194 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:39:57.775386 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-79b852a9-412b-4a8c-b030-590799be4588 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:39:57.775892 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-79b852a9-412b-4a8c-b030-590799be4588 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: 42acb210-bef2-4e45-9b48-ed1c75fdf191] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:39:57.782387 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-79b852a9-412b-4a8c-b030-590799be4588 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:57.782896 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-79b852a9-412b-4a8c-b030-590799be4588 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:57.783331 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-79b852a9-412b-4a8c-b030-590799be4588 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:57.784042 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-79b852a9-412b-4a8c-b030-590799be4588 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:57.784520 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-79b852a9-412b-4a8c-b030-590799be4588 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:57.784942 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-79b852a9-412b-4a8c-b030-590799be4588 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:57.865030 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.objects.instance [None req-79b852a9-412b-4a8c-b030-590799be4588 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lazy-loading 'services' on Instance uuid 42acb210-bef2-4e45-9b48-ed1c75fdf191 {{(pid=120648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 30 19:39:57.974278 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-79b852a9-412b-4a8c-b030-590799be4588 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "DELETE /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191/os-volume_attachments/fca66295-f727-4ee7-907f-40579a44092f" status: 202 len: 0 microversion: 2.1 time: 0.202614 Sep 30 19:39:57.974843 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 488/1017] 10.222.0.17 () {58 vars in 1416 bytes} [Fri Sep 30 19:39:57 2022] DELETE /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191/os-volume_attachments/fca66295-f727-4ee7-907f-40579a44092f => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 30 19:39:57.984228 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-5e2a16d0-6a60-41af-bb26-8f47e712e524 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:39:57.987219 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-5e2a16d0-6a60-41af-bb26-8f47e712e524 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: 42acb210-bef2-4e45-9b48-ed1c75fdf191] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:39:57.993459 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5e2a16d0-6a60-41af-bb26-8f47e712e524 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:57.993944 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5e2a16d0-6a60-41af-bb26-8f47e712e524 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:57.994388 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5e2a16d0-6a60-41af-bb26-8f47e712e524 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:57.995111 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5e2a16d0-6a60-41af-bb26-8f47e712e524 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:57.995551 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5e2a16d0-6a60-41af-bb26-8f47e712e524 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:57.996325 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5e2a16d0-6a60-41af-bb26-8f47e712e524 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:58.024746 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-5e2a16d0-6a60-41af-bb26-8f47e712e524 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045370 Sep 30 19:39:58.025302 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 530/1018] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 30 19:39:57 2022] GET /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:39:59.038517 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-f3203b65-c3f6-4eac-aa2f-0b3736039fb8 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:39:59.040840 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-f3203b65-c3f6-4eac-aa2f-0b3736039fb8 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: 42acb210-bef2-4e45-9b48-ed1c75fdf191] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:39:59.047533 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f3203b65-c3f6-4eac-aa2f-0b3736039fb8 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:59.048019 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f3203b65-c3f6-4eac-aa2f-0b3736039fb8 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:59.048488 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f3203b65-c3f6-4eac-aa2f-0b3736039fb8 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:59.049179 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f3203b65-c3f6-4eac-aa2f-0b3736039fb8 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:39:59.049634 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f3203b65-c3f6-4eac-aa2f-0b3736039fb8 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:39:59.050062 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f3203b65-c3f6-4eac-aa2f-0b3736039fb8 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:39:59.079141 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-f3203b65-c3f6-4eac-aa2f-0b3736039fb8 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045728 Sep 30 19:39:59.079673 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 489/1019] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 30 19:39:59 2022] GET /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:40:00.091866 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-092720d7-8d35-44c8-9488-dfabb65259b7 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:40:00.094646 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-092720d7-8d35-44c8-9488-dfabb65259b7 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: 42acb210-bef2-4e45-9b48-ed1c75fdf191] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:40:00.101213 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-092720d7-8d35-44c8-9488-dfabb65259b7 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:00.101697 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-092720d7-8d35-44c8-9488-dfabb65259b7 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:00.102137 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-092720d7-8d35-44c8-9488-dfabb65259b7 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:00.102825 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-092720d7-8d35-44c8-9488-dfabb65259b7 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:00.103277 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-092720d7-8d35-44c8-9488-dfabb65259b7 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:00.103702 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-092720d7-8d35-44c8-9488-dfabb65259b7 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:00.132935 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-092720d7-8d35-44c8-9488-dfabb65259b7 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044947 Sep 30 19:40:00.133775 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 531/1020] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 30 19:40:00 2022] GET /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:40:01.145666 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-42619831-6ede-43f6-bbf4-d585063b3922 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:40:01.147839 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-42619831-6ede-43f6-bbf4-d585063b3922 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: 42acb210-bef2-4e45-9b48-ed1c75fdf191] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:40:01.154217 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-42619831-6ede-43f6-bbf4-d585063b3922 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:01.154702 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-42619831-6ede-43f6-bbf4-d585063b3922 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:01.155140 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-42619831-6ede-43f6-bbf4-d585063b3922 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:01.155825 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-42619831-6ede-43f6-bbf4-d585063b3922 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:01.156779 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-42619831-6ede-43f6-bbf4-d585063b3922 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:01.157285 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-42619831-6ede-43f6-bbf4-d585063b3922 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:01.185891 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-42619831-6ede-43f6-bbf4-d585063b3922 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044202 Sep 30 19:40:01.186666 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 490/1021] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 30 19:40:01 2022] GET /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:40:02.198420 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-8ad500e6-ce23-4df0-beb4-fb773d748a99 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:40:02.200729 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-8ad500e6-ce23-4df0-beb4-fb773d748a99 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: 42acb210-bef2-4e45-9b48-ed1c75fdf191] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:40:02.207163 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8ad500e6-ce23-4df0-beb4-fb773d748a99 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:02.207654 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8ad500e6-ce23-4df0-beb4-fb773d748a99 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:02.208096 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8ad500e6-ce23-4df0-beb4-fb773d748a99 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:02.208825 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8ad500e6-ce23-4df0-beb4-fb773d748a99 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:02.209290 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8ad500e6-ce23-4df0-beb4-fb773d748a99 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:02.209724 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8ad500e6-ce23-4df0-beb4-fb773d748a99 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:02.240040 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-8ad500e6-ce23-4df0-beb4-fb773d748a99 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045597 Sep 30 19:40:02.240631 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 532/1022] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 30 19:40:02 2022] GET /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:40:03.253128 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-9c9ccb48-f30f-4e1e-ae34-14eb0b17c1e0 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:40:03.255240 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-9c9ccb48-f30f-4e1e-ae34-14eb0b17c1e0 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: 42acb210-bef2-4e45-9b48-ed1c75fdf191] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:40:03.261512 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9c9ccb48-f30f-4e1e-ae34-14eb0b17c1e0 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:03.261991 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9c9ccb48-f30f-4e1e-ae34-14eb0b17c1e0 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:03.262426 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9c9ccb48-f30f-4e1e-ae34-14eb0b17c1e0 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:03.263114 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9c9ccb48-f30f-4e1e-ae34-14eb0b17c1e0 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:03.263566 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9c9ccb48-f30f-4e1e-ae34-14eb0b17c1e0 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:03.263991 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9c9ccb48-f30f-4e1e-ae34-14eb0b17c1e0 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:03.297678 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-9c9ccb48-f30f-4e1e-ae34-14eb0b17c1e0 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049042 Sep 30 19:40:03.298226 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 491/1023] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 30 19:40:03 2022] GET /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 30 19:40:03.360588 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-0444a8b5-45f1-4e79-9d3d-cbc6b6fcc89a tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:40:03.361105 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-0444a8b5-45f1-4e79-9d3d-cbc6b6fcc89a tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: 42acb210-bef2-4e45-9b48-ed1c75fdf191] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:40:03.367313 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0444a8b5-45f1-4e79-9d3d-cbc6b6fcc89a tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:03.367792 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0444a8b5-45f1-4e79-9d3d-cbc6b6fcc89a tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:03.368228 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0444a8b5-45f1-4e79-9d3d-cbc6b6fcc89a tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:03.368947 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0444a8b5-45f1-4e79-9d3d-cbc6b6fcc89a tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:03.369397 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0444a8b5-45f1-4e79-9d3d-cbc6b6fcc89a tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:03.369813 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0444a8b5-45f1-4e79-9d3d-cbc6b6fcc89a tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:03.397027 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-0444a8b5-45f1-4e79-9d3d-cbc6b6fcc89a tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: 42acb210-bef2-4e45-9b48-ed1c75fdf191] Going to try to terminate instance {{(pid=120649) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 30 19:40:03.469932 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-0444a8b5-45f1-4e79-9d3d-cbc6b6fcc89a tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "DELETE /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191" status: 204 len: 0 microversion: 2.1 time: 0.112865 Sep 30 19:40:03.470515 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 533/1024] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 30 19:40:03 2022] DELETE /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 30 19:40:03.478770 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-10709fb4-3cfd-4f53-b987-95d99b4ff736 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:40:03.479387 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-10709fb4-3cfd-4f53-b987-95d99b4ff736 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: 42acb210-bef2-4e45-9b48-ed1c75fdf191] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:40:03.485716 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-10709fb4-3cfd-4f53-b987-95d99b4ff736 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:03.486137 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-10709fb4-3cfd-4f53-b987-95d99b4ff736 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:03.486572 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-10709fb4-3cfd-4f53-b987-95d99b4ff736 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:03.487256 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-10709fb4-3cfd-4f53-b987-95d99b4ff736 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:03.487710 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-10709fb4-3cfd-4f53-b987-95d99b4ff736 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:03.488135 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-10709fb4-3cfd-4f53-b987-95d99b4ff736 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:03.618762 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-10709fb4-3cfd-4f53-b987-95d99b4ff736 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:40:03.626996 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-10709fb4-3cfd-4f53-b987-95d99b4ff736 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191" status: 200 len: 1681 microversion: 2.1 time: 0.152031 Sep 30 19:40:03.627549 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 492/1025] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:40:03 2022] GET /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:40:04.650782 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-8fd0c8b2-4ebb-40df-a662-a8128b7ce66b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:40:04.651533 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-8fd0c8b2-4ebb-40df-a662-a8128b7ce66b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: 42acb210-bef2-4e45-9b48-ed1c75fdf191] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:40:04.657970 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8fd0c8b2-4ebb-40df-a662-a8128b7ce66b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:04.658499 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8fd0c8b2-4ebb-40df-a662-a8128b7ce66b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:04.658933 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8fd0c8b2-4ebb-40df-a662-a8128b7ce66b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:04.659692 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8fd0c8b2-4ebb-40df-a662-a8128b7ce66b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:04.660122 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8fd0c8b2-4ebb-40df-a662-a8128b7ce66b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:04.660935 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8fd0c8b2-4ebb-40df-a662-a8128b7ce66b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:04.789143 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-8fd0c8b2-4ebb-40df-a662-a8128b7ce66b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:40:04.797009 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-8fd0c8b2-4ebb-40df-a662-a8128b7ce66b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191" status: 200 len: 1681 microversion: 2.1 time: 0.150685 Sep 30 19:40:04.797585 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 534/1026] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:40:04 2022] GET /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:40:05.820615 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-22c145a4-0da7-480b-b41a-97fd964dff04 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:40:05.821233 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-22c145a4-0da7-480b-b41a-97fd964dff04 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: 42acb210-bef2-4e45-9b48-ed1c75fdf191] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:40:05.827790 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-22c145a4-0da7-480b-b41a-97fd964dff04 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:05.828833 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-22c145a4-0da7-480b-b41a-97fd964dff04 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:05.829278 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-22c145a4-0da7-480b-b41a-97fd964dff04 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:05.829979 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-22c145a4-0da7-480b-b41a-97fd964dff04 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:05.830429 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-22c145a4-0da7-480b-b41a-97fd964dff04 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:05.830855 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-22c145a4-0da7-480b-b41a-97fd964dff04 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:06.001315 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-22c145a4-0da7-480b-b41a-97fd964dff04 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:40:06.011048 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-22c145a4-0da7-480b-b41a-97fd964dff04 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191" status: 200 len: 1681 microversion: 2.1 time: 0.193883 Sep 30 19:40:06.012360 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 493/1027] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:40:05 2022] GET /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191 => generated 1681 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:40:06.704802 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [req-dfc354f1-3bbe-4904-a263-5d9823981109 req-4fb7b7df-38a0-4fa5-8007-4b3fbae8c020 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42acb210-bef2-4e45-9b48-ed1c75fdf191", "name": "network-vif-deleted", "tag": "84d6b83f-065d-42d4-ba43-89413a1e2ec8"}]} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:40:06.723119 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:40:06.727890 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-dfc354f1-3bbe-4904-a263-5d9823981109 req-4fb7b7df-38a0-4fa5-8007-4b3fbae8c020 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:06.728690 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-dfc354f1-3bbe-4904-a263-5d9823981109 req-4fb7b7df-38a0-4fa5-8007-4b3fbae8c020 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:06.730240 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-dfc354f1-3bbe-4904-a263-5d9823981109 req-4fb7b7df-38a0-4fa5-8007-4b3fbae8c020 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:06.755477 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.compute.server_external_events [req-dfc354f1-3bbe-4904-a263-5d9823981109 req-4fb7b7df-38a0-4fa5-8007-4b3fbae8c020 service nova] Creating event network-vif-deleted:84d6b83f-065d-42d4-ba43-89413a1e2ec8 for instance 42acb210-bef2-4e45-9b48-ed1c75fdf191 on hv-cinder-86001 Sep 30 19:40:06.765318 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [req-dfc354f1-3bbe-4904-a263-5d9823981109 req-4fb7b7df-38a0-4fa5-8007-4b3fbae8c020 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073523 Sep 30 19:40:06.765959 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 535/1028] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:40:07.038347 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-9ce16dd3-134f-4c57-8a39-78fd060af32c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:40:07.040734 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-9ce16dd3-134f-4c57-8a39-78fd060af32c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: 42acb210-bef2-4e45-9b48-ed1c75fdf191] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:40:07.048925 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9ce16dd3-134f-4c57-8a39-78fd060af32c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:07.049664 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9ce16dd3-134f-4c57-8a39-78fd060af32c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:07.050221 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9ce16dd3-134f-4c57-8a39-78fd060af32c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:07.051021 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9ce16dd3-134f-4c57-8a39-78fd060af32c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:07.051574 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9ce16dd3-134f-4c57-8a39-78fd060af32c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:07.052067 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9ce16dd3-134f-4c57-8a39-78fd060af32c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:07.084847 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9ce16dd3-134f-4c57-8a39-78fd060af32c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:07.085406 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9ce16dd3-134f-4c57-8a39-78fd060af32c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:07.085923 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9ce16dd3-134f-4c57-8a39-78fd060af32c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:07.086647 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.objects.instance [None req-9ce16dd3-134f-4c57-8a39-78fd060af32c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lazy-loading 'fault' on Instance uuid 42acb210-bef2-4e45-9b48-ed1c75fdf191 {{(pid=120648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 30 19:40:07.133342 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-9ce16dd3-134f-4c57-8a39-78fd060af32c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbdadc310fc4bf8a6679bcb39b34ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612fb8a339e4478ba78bc5ef3b343b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:40:07.141192 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-9ce16dd3-134f-4c57-8a39-78fd060af32c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191" status: 200 len: 1331 microversion: 2.1 time: 0.108529 Sep 30 19:40:07.141765 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 494/1029] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:40:07 2022] GET /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191 => generated 1331 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:40:08.166033 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-7d9ac4b9-7b42-47e7-95e6-32561e3b45d4 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:40:08.166724 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-7d9ac4b9-7b42-47e7-95e6-32561e3b45d4 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: 42acb210-bef2-4e45-9b48-ed1c75fdf191] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:40:08.173501 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7d9ac4b9-7b42-47e7-95e6-32561e3b45d4 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:08.173980 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7d9ac4b9-7b42-47e7-95e6-32561e3b45d4 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:08.174412 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7d9ac4b9-7b42-47e7-95e6-32561e3b45d4 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:08.175102 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7d9ac4b9-7b42-47e7-95e6-32561e3b45d4 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:08.175552 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7d9ac4b9-7b42-47e7-95e6-32561e3b45d4 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:08.175974 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7d9ac4b9-7b42-47e7-95e6-32561e3b45d4 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:08.189943 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.wsgi [None req-7d9ac4b9-7b42-47e7-95e6-32561e3b45d4 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] HTTP exception thrown: Instance 42acb210-bef2-4e45-9b48-ed1c75fdf191 could not be found. Sep 30 19:40:08.191587 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-7d9ac4b9-7b42-47e7-95e6-32561e3b45d4 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Request method failure captured: Sep 30 19:40:08.191587 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: request: GET /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191 HTTP/1.1 Sep 30 19:40:08.191587 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Accept: application/json Sep 30 19:40:08.191587 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Accept-Encoding: identity Sep 30 19:40:08.191587 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Connection: close Sep 30 19:40:08.191587 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Content-Length: 0 Sep 30 19:40:08.191587 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Content-Type: application/json Sep 30 19:40:08.191587 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Host: 10.222.0.17 Sep 30 19:40:08.191587 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Openstack-System-Scope: None Sep 30 19:40:08.191587 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: User-Agent: python-urllib3/1.26.12 Sep 30 19:40:08.191587 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Auth-Token: gAAAAABjN0ONqtIDYC2-7JPJhRMwDTFX77ua7wCzld6d05rw2OAypY6C9ruPlCf9je7iHOPQdEHBIS7fQsYNQwwCaWegqx7UtPiHvBb_B_GTauKCWL_cl9osIiSIgmJPV0ud6nFHwFaWS29rEhsSYVXTP0g-WZEwpi_MPh4YPjuB1sskH-bvyg0 Sep 30 19:40:08.191587 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Domain-Id: None Sep 30 19:40:08.191587 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Domain-Name: None Sep 30 19:40:08.191587 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Identity-Status: Confirmed Sep 30 19:40:08.191587 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Is-Admin-Project: True Sep 30 19:40:08.191587 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Domain-Id: default Sep 30 19:40:08.191587 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Domain-Name: Default Sep 30 19:40:08.191587 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Id: 612fb8a339e4478ba78bc5ef3b343b82 Sep 30 19:40:08.191587 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Name: tempest-AttachVolumeNegativeTest-1614355089 Sep 30 19:40:08.191587 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Role: member,reader Sep 30 19:40:08.191587 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Roles: member,reader Sep 30 19:40:08.193183 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/612fb8a339e4478ba78bc5ef3b343b82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/612fb8a339e4478ba78bc5ef3b343b82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/612fb8a339e4478ba78bc5ef3b343b82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_612fb8a339e4478ba78bc5ef3b343b82"}]}] Sep 30 19:40:08.193183 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant: tempest-AttachVolumeNegativeTest-1614355089 Sep 30 19:40:08.193183 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant-Id: 612fb8a339e4478ba78bc5ef3b343b82 Sep 30 19:40:08.193183 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1614355089 Sep 30 19:40:08.193183 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User: tempest-AttachVolumeNegativeTest-1614355089-project Sep 30 19:40:08.193183 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Domain-Id: default Sep 30 19:40:08.193183 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Domain-Name: Default Sep 30 19:40:08.193183 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Id: ccbdadc310fc4bf8a6679bcb39b34ff1 Sep 30 19:40:08.193183 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Name: tempest-AttachVolumeNegativeTest-1614355089-project Sep 30 19:40:08.193183 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: method: > Sep 30 19:40:08.193183 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: exception: Instance 42acb210-bef2-4e45-9b48-ed1c75fdf191 could not be found. Sep 30 19:40:08.193183 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: action_args: {'id': '42acb210-bef2-4e45-9b48-ed1c75fdf191'} Sep 30 19:40:08.194052 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:40:08.194052 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:40:08.194052 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 30 19:40:08.194052 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 30 19:40:08.194052 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 30 19:40:08.194052 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 30 19:40:08.194052 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 30 19:40:08.194052 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 30 19:40:08.194052 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 30 19:40:08.194052 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 30 19:40:08.194052 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42acb210-bef2-4e45-9b48-ed1c75fdf191 could not be found. Sep 30 19:40:08.194052 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:40:08.194052 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:40:08.194052 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:40:08.194052 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:40:08.194052 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:40:08.194052 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:40:08.194052 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:40:08.194052 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:40:08.194052 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:40:08.195546 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:40:08.195546 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 30 19:40:08.195546 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 30 19:40:08.195546 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 30 19:40:08.195546 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 30 19:40:08.195546 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 30 19:40:08.195546 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 30 19:40:08.195546 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42acb210-bef2-4e45-9b48-ed1c75fdf191 could not be found. Sep 30 19:40:08.195546 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:40:08.195546 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:40:08.195546 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:40:08.195546 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:40:08.195546 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:40:08.195546 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:40:08.195546 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:40:08.195546 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:40:08.195546 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42acb210-bef2-4e45-9b48-ed1c75fdf191 could not be found. Sep 30 19:40:08.195546 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:40:08.196895 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-7d9ac4b9-7b42-47e7-95e6-32561e3b45d4 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Returning 404 to user: Instance 42acb210-bef2-4e45-9b48-ed1c75fdf191 could not be found. {{(pid=120649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:40:08.196895 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-7d9ac4b9-7b42-47e7-95e6-32561e3b45d4 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191" status: 404 len: 111 microversion: 2.1 time: 0.032485 Sep 30 19:40:08.196895 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 536/1030] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:40:08 2022] GET /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 30 19:40:08.203501 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-7a43e076-77e6-46e2-931c-9cabc76ad80e tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '.version_select at 0x7f621ee77a60>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:40:08.222945 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-7a43e076-77e6-46e2-931c-9cabc76ad80e tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-629945437" status: 202 len: 0 microversion: 2.1 time: 0.023643 Sep 30 19:40:08.223538 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 495/1031] 10.222.0.17 () {58 vars in 1218 bytes} [Fri Sep 30 19:40:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-629945437 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 30 19:40:10.252961 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-591c4b90-8b59-4692-933b-7639e7289b8d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:40:10.253469 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-591c4b90-8b59-4692-933b-7639e7289b8d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: 42acb210-bef2-4e45-9b48-ed1c75fdf191] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:40:10.259671 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-591c4b90-8b59-4692-933b-7639e7289b8d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:10.260152 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-591c4b90-8b59-4692-933b-7639e7289b8d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:10.260627 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-591c4b90-8b59-4692-933b-7639e7289b8d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:10.261319 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-591c4b90-8b59-4692-933b-7639e7289b8d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:10.261767 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-591c4b90-8b59-4692-933b-7639e7289b8d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:10.262192 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-591c4b90-8b59-4692-933b-7639e7289b8d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:10.276239 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.wsgi [None req-591c4b90-8b59-4692-933b-7639e7289b8d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] HTTP exception thrown: Instance 42acb210-bef2-4e45-9b48-ed1c75fdf191 could not be found. Sep 30 19:40:10.277805 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-591c4b90-8b59-4692-933b-7639e7289b8d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Request method failure captured: Sep 30 19:40:10.277805 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: request: DELETE /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191 HTTP/1.1 Sep 30 19:40:10.277805 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Accept: application/json Sep 30 19:40:10.277805 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Accept-Encoding: identity Sep 30 19:40:10.277805 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Connection: close Sep 30 19:40:10.277805 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Content-Length: 0 Sep 30 19:40:10.277805 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Content-Type: application/json Sep 30 19:40:10.277805 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Host: 10.222.0.17 Sep 30 19:40:10.277805 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Openstack-System-Scope: None Sep 30 19:40:10.277805 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: User-Agent: python-urllib3/1.26.12 Sep 30 19:40:10.277805 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Auth-Token: gAAAAABjN0ONqtIDYC2-7JPJhRMwDTFX77ua7wCzld6d05rw2OAypY6C9ruPlCf9je7iHOPQdEHBIS7fQsYNQwwCaWegqx7UtPiHvBb_B_GTauKCWL_cl9osIiSIgmJPV0ud6nFHwFaWS29rEhsSYVXTP0g-WZEwpi_MPh4YPjuB1sskH-bvyg0 Sep 30 19:40:10.277805 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Domain-Id: None Sep 30 19:40:10.277805 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Domain-Name: None Sep 30 19:40:10.277805 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Identity-Status: Confirmed Sep 30 19:40:10.277805 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Is-Admin-Project: True Sep 30 19:40:10.277805 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Domain-Id: default Sep 30 19:40:10.277805 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Domain-Name: Default Sep 30 19:40:10.277805 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Id: 612fb8a339e4478ba78bc5ef3b343b82 Sep 30 19:40:10.277805 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Name: tempest-AttachVolumeNegativeTest-1614355089 Sep 30 19:40:10.277805 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Role: member,reader Sep 30 19:40:10.277805 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Roles: member,reader Sep 30 19:40:10.279437 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/612fb8a339e4478ba78bc5ef3b343b82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/612fb8a339e4478ba78bc5ef3b343b82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/612fb8a339e4478ba78bc5ef3b343b82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_612fb8a339e4478ba78bc5ef3b343b82"}]}] Sep 30 19:40:10.279437 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant: tempest-AttachVolumeNegativeTest-1614355089 Sep 30 19:40:10.279437 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant-Id: 612fb8a339e4478ba78bc5ef3b343b82 Sep 30 19:40:10.279437 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1614355089 Sep 30 19:40:10.279437 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User: tempest-AttachVolumeNegativeTest-1614355089-project Sep 30 19:40:10.279437 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Domain-Id: default Sep 30 19:40:10.279437 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Domain-Name: Default Sep 30 19:40:10.279437 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Id: ccbdadc310fc4bf8a6679bcb39b34ff1 Sep 30 19:40:10.279437 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Name: tempest-AttachVolumeNegativeTest-1614355089-project Sep 30 19:40:10.279437 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: method: > Sep 30 19:40:10.279437 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: exception: Instance 42acb210-bef2-4e45-9b48-ed1c75fdf191 could not be found. Sep 30 19:40:10.279437 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: action_args: {'id': '42acb210-bef2-4e45-9b48-ed1c75fdf191'} Sep 30 19:40:10.280242 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:40:10.280242 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:40:10.280242 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 30 19:40:10.280242 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 30 19:40:10.280242 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 30 19:40:10.280242 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 30 19:40:10.280242 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 30 19:40:10.280242 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 30 19:40:10.280242 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 30 19:40:10.280242 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 30 19:40:10.280242 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42acb210-bef2-4e45-9b48-ed1c75fdf191 could not be found. Sep 30 19:40:10.280242 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:40:10.280242 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:40:10.280242 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:40:10.280242 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:40:10.280242 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:40:10.280242 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:40:10.280242 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:40:10.280242 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:40:10.280242 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:40:10.284264 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:40:10.284264 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 30 19:40:10.284264 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 30 19:40:10.284264 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 30 19:40:10.284264 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 30 19:40:10.284264 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 30 19:40:10.284264 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 30 19:40:10.284264 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 30 19:40:10.284264 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 30 19:40:10.284264 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42acb210-bef2-4e45-9b48-ed1c75fdf191 could not be found. Sep 30 19:40:10.284264 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:40:10.284264 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:40:10.284264 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:40:10.284264 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:40:10.284264 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:40:10.284264 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:40:10.284264 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:40:10.284264 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:40:10.284264 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42acb210-bef2-4e45-9b48-ed1c75fdf191 could not be found. Sep 30 19:40:10.284264 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:40:10.285889 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-591c4b90-8b59-4692-933b-7639e7289b8d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Returning 404 to user: Instance 42acb210-bef2-4e45-9b48-ed1c75fdf191 could not be found. {{(pid=120649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:40:10.285889 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-591c4b90-8b59-4692-933b-7639e7289b8d tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "DELETE /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191" status: 404 len: 111 microversion: 2.1 time: 0.030623 Sep 30 19:40:10.285889 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 537/1032] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 30 19:40:10 2022] DELETE /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 30 19:40:10.289487 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-6a1750d1-1084-4009-a672-f81985113759 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:40:10.290109 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-6a1750d1-1084-4009-a672-f81985113759 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: 42acb210-bef2-4e45-9b48-ed1c75fdf191] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:40:10.297516 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6a1750d1-1084-4009-a672-f81985113759 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:10.298001 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6a1750d1-1084-4009-a672-f81985113759 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:10.298437 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6a1750d1-1084-4009-a672-f81985113759 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:10.299133 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6a1750d1-1084-4009-a672-f81985113759 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:10.299600 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6a1750d1-1084-4009-a672-f81985113759 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:10.300023 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6a1750d1-1084-4009-a672-f81985113759 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:10.317513 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.wsgi [None req-6a1750d1-1084-4009-a672-f81985113759 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] HTTP exception thrown: Instance 42acb210-bef2-4e45-9b48-ed1c75fdf191 could not be found. Sep 30 19:40:10.319301 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-6a1750d1-1084-4009-a672-f81985113759 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Request method failure captured: Sep 30 19:40:10.319301 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: request: GET /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191 HTTP/1.1 Sep 30 19:40:10.319301 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 30 19:40:10.319301 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 30 19:40:10.319301 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Connection: close Sep 30 19:40:10.319301 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Length: 0 Sep 30 19:40:10.319301 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 30 19:40:10.319301 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Host: 10.222.0.17 Sep 30 19:40:10.319301 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 30 19:40:10.319301 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 30 19:40:10.319301 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjN0ONqtIDYC2-7JPJhRMwDTFX77ua7wCzld6d05rw2OAypY6C9ruPlCf9je7iHOPQdEHBIS7fQsYNQwwCaWegqx7UtPiHvBb_B_GTauKCWL_cl9osIiSIgmJPV0ud6nFHwFaWS29rEhsSYVXTP0g-WZEwpi_MPh4YPjuB1sskH-bvyg0 Sep 30 19:40:10.319301 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 30 19:40:10.319301 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 30 19:40:10.319301 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 30 19:40:10.319301 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 30 19:40:10.319301 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 30 19:40:10.319301 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 30 19:40:10.319301 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Id: 612fb8a339e4478ba78bc5ef3b343b82 Sep 30 19:40:10.319301 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-AttachVolumeNegativeTest-1614355089 Sep 30 19:40:10.319301 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 30 19:40:10.319301 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 30 19:40:10.320849 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/612fb8a339e4478ba78bc5ef3b343b82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/612fb8a339e4478ba78bc5ef3b343b82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/612fb8a339e4478ba78bc5ef3b343b82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_612fb8a339e4478ba78bc5ef3b343b82"}]}] Sep 30 19:40:10.320849 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-AttachVolumeNegativeTest-1614355089 Sep 30 19:40:10.320849 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Id: 612fb8a339e4478ba78bc5ef3b343b82 Sep 30 19:40:10.320849 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1614355089 Sep 30 19:40:10.320849 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User: tempest-AttachVolumeNegativeTest-1614355089-project Sep 30 19:40:10.320849 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 30 19:40:10.320849 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 30 19:40:10.320849 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Id: ccbdadc310fc4bf8a6679bcb39b34ff1 Sep 30 19:40:10.320849 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-AttachVolumeNegativeTest-1614355089-project Sep 30 19:40:10.320849 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: method: > Sep 30 19:40:10.320849 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: exception: Instance 42acb210-bef2-4e45-9b48-ed1c75fdf191 could not be found. Sep 30 19:40:10.320849 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: action_args: {'id': '42acb210-bef2-4e45-9b48-ed1c75fdf191'} Sep 30 19:40:10.321752 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:40:10.321752 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:40:10.321752 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 30 19:40:10.321752 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 30 19:40:10.321752 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 30 19:40:10.321752 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 30 19:40:10.321752 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 30 19:40:10.321752 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 30 19:40:10.321752 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 30 19:40:10.321752 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 30 19:40:10.321752 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42acb210-bef2-4e45-9b48-ed1c75fdf191 could not be found. Sep 30 19:40:10.321752 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:40:10.321752 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:40:10.321752 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:40:10.321752 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:40:10.321752 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:40:10.321752 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:40:10.321752 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:40:10.321752 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:40:10.321752 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:40:10.322994 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:40:10.322994 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 30 19:40:10.322994 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 30 19:40:10.322994 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 30 19:40:10.322994 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 30 19:40:10.322994 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 30 19:40:10.322994 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 30 19:40:10.322994 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42acb210-bef2-4e45-9b48-ed1c75fdf191 could not be found. Sep 30 19:40:10.322994 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:40:10.322994 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:40:10.322994 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:40:10.322994 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:40:10.322994 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:40:10.322994 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:40:10.322994 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:40:10.322994 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:40:10.322994 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42acb210-bef2-4e45-9b48-ed1c75fdf191 could not be found. Sep 30 19:40:10.322994 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:40:10.324141 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-6a1750d1-1084-4009-a672-f81985113759 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Returning 404 to user: Instance 42acb210-bef2-4e45-9b48-ed1c75fdf191 could not be found. {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:40:10.324141 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-6a1750d1-1084-4009-a672-f81985113759 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191" status: 404 len: 111 microversion: 2.1 time: 0.035985 Sep 30 19:40:10.324141 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 496/1033] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:40:10 2022] GET /compute/v2.1/servers/42acb210-bef2-4e45-9b48-ed1c75fdf191 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 30 19:40:11.474384 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-b3397238-e956-46c3-b9ff-04758333e08c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:40:11.474880 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-b3397238-e956-46c3-b9ff-04758333e08c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: 0aa829ac-05b3-4eba-89ed-39195a559ea4] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:40:11.481365 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b3397238-e956-46c3-b9ff-04758333e08c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:11.481849 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b3397238-e956-46c3-b9ff-04758333e08c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:11.482288 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b3397238-e956-46c3-b9ff-04758333e08c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:11.483156 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b3397238-e956-46c3-b9ff-04758333e08c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:11.484140 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b3397238-e956-46c3-b9ff-04758333e08c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:11.484606 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b3397238-e956-46c3-b9ff-04758333e08c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:11.498328 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.wsgi [None req-b3397238-e956-46c3-b9ff-04758333e08c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] HTTP exception thrown: Instance 0aa829ac-05b3-4eba-89ed-39195a559ea4 could not be found. Sep 30 19:40:11.500472 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-b3397238-e956-46c3-b9ff-04758333e08c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Request method failure captured: Sep 30 19:40:11.500472 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: request: DELETE /compute/v2.1/servers/0aa829ac-05b3-4eba-89ed-39195a559ea4 HTTP/1.1 Sep 30 19:40:11.500472 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Accept: application/json Sep 30 19:40:11.500472 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Accept-Encoding: identity Sep 30 19:40:11.500472 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Connection: close Sep 30 19:40:11.500472 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Content-Length: 0 Sep 30 19:40:11.500472 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Content-Type: application/json Sep 30 19:40:11.500472 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Host: 10.222.0.17 Sep 30 19:40:11.500472 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Openstack-System-Scope: None Sep 30 19:40:11.500472 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: User-Agent: python-urllib3/1.26.12 Sep 30 19:40:11.500472 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Auth-Token: gAAAAABjN0ONqtIDYC2-7JPJhRMwDTFX77ua7wCzld6d05rw2OAypY6C9ruPlCf9je7iHOPQdEHBIS7fQsYNQwwCaWegqx7UtPiHvBb_B_GTauKCWL_cl9osIiSIgmJPV0ud6nFHwFaWS29rEhsSYVXTP0g-WZEwpi_MPh4YPjuB1sskH-bvyg0 Sep 30 19:40:11.500472 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Domain-Id: None Sep 30 19:40:11.500472 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Domain-Name: None Sep 30 19:40:11.500472 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Identity-Status: Confirmed Sep 30 19:40:11.500472 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Is-Admin-Project: True Sep 30 19:40:11.500472 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Domain-Id: default Sep 30 19:40:11.500472 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Domain-Name: Default Sep 30 19:40:11.500472 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Id: 612fb8a339e4478ba78bc5ef3b343b82 Sep 30 19:40:11.500472 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Name: tempest-AttachVolumeNegativeTest-1614355089 Sep 30 19:40:11.500472 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Role: member,reader Sep 30 19:40:11.500472 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Roles: member,reader Sep 30 19:40:11.501865 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/612fb8a339e4478ba78bc5ef3b343b82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/612fb8a339e4478ba78bc5ef3b343b82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/612fb8a339e4478ba78bc5ef3b343b82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_612fb8a339e4478ba78bc5ef3b343b82"}]}] Sep 30 19:40:11.501865 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant: tempest-AttachVolumeNegativeTest-1614355089 Sep 30 19:40:11.501865 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant-Id: 612fb8a339e4478ba78bc5ef3b343b82 Sep 30 19:40:11.501865 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1614355089 Sep 30 19:40:11.501865 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User: tempest-AttachVolumeNegativeTest-1614355089-project Sep 30 19:40:11.501865 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Domain-Id: default Sep 30 19:40:11.501865 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Domain-Name: Default Sep 30 19:40:11.501865 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Id: ccbdadc310fc4bf8a6679bcb39b34ff1 Sep 30 19:40:11.501865 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Name: tempest-AttachVolumeNegativeTest-1614355089-project Sep 30 19:40:11.501865 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: method: > Sep 30 19:40:11.501865 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: exception: Instance 0aa829ac-05b3-4eba-89ed-39195a559ea4 could not be found. Sep 30 19:40:11.501865 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: action_args: {'id': '0aa829ac-05b3-4eba-89ed-39195a559ea4'} Sep 30 19:40:11.502836 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:40:11.502836 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:40:11.502836 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 30 19:40:11.502836 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 30 19:40:11.502836 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 30 19:40:11.502836 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 30 19:40:11.502836 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 30 19:40:11.502836 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 30 19:40:11.502836 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 30 19:40:11.502836 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 30 19:40:11.502836 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0aa829ac-05b3-4eba-89ed-39195a559ea4 could not be found. Sep 30 19:40:11.502836 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:40:11.502836 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:40:11.502836 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:40:11.502836 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:40:11.502836 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:40:11.502836 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:40:11.502836 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:40:11.502836 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:40:11.502836 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:40:11.504102 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:40:11.504102 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 30 19:40:11.504102 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 30 19:40:11.504102 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 30 19:40:11.504102 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 30 19:40:11.504102 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 30 19:40:11.504102 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 30 19:40:11.504102 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 30 19:40:11.504102 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 30 19:40:11.504102 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0aa829ac-05b3-4eba-89ed-39195a559ea4 could not be found. Sep 30 19:40:11.504102 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:40:11.504102 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:40:11.504102 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:40:11.504102 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:40:11.504102 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:40:11.504102 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:40:11.504102 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:40:11.504102 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:40:11.504102 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0aa829ac-05b3-4eba-89ed-39195a559ea4 could not be found. Sep 30 19:40:11.504102 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:40:11.506201 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-b3397238-e956-46c3-b9ff-04758333e08c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Returning 404 to user: Instance 0aa829ac-05b3-4eba-89ed-39195a559ea4 could not be found. {{(pid=120649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:40:11.506201 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-b3397238-e956-46c3-b9ff-04758333e08c tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0aa829ac-05b3-4eba-89ed-39195a559ea4" status: 404 len: 111 microversion: 2.1 time: 0.031511 Sep 30 19:40:11.506201 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 538/1034] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 30 19:40:11 2022] DELETE /compute/v2.1/servers/0aa829ac-05b3-4eba-89ed-39195a559ea4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 30 19:40:11.510479 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e0fdf3bb-c863-4e96-8d20-a1a06c691e9b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:40:11.511090 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-e0fdf3bb-c863-4e96-8d20-a1a06c691e9b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: 0aa829ac-05b3-4eba-89ed-39195a559ea4] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:40:11.518158 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e0fdf3bb-c863-4e96-8d20-a1a06c691e9b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:11.518635 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e0fdf3bb-c863-4e96-8d20-a1a06c691e9b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:11.519069 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e0fdf3bb-c863-4e96-8d20-a1a06c691e9b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:11.519879 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e0fdf3bb-c863-4e96-8d20-a1a06c691e9b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:11.520264 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e0fdf3bb-c863-4e96-8d20-a1a06c691e9b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:11.520641 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e0fdf3bb-c863-4e96-8d20-a1a06c691e9b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:11.534412 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.wsgi [None req-e0fdf3bb-c863-4e96-8d20-a1a06c691e9b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] HTTP exception thrown: Instance 0aa829ac-05b3-4eba-89ed-39195a559ea4 could not be found. Sep 30 19:40:11.536173 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e0fdf3bb-c863-4e96-8d20-a1a06c691e9b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Request method failure captured: Sep 30 19:40:11.536173 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: request: GET /compute/v2.1/servers/0aa829ac-05b3-4eba-89ed-39195a559ea4 HTTP/1.1 Sep 30 19:40:11.536173 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 30 19:40:11.536173 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 30 19:40:11.536173 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Connection: close Sep 30 19:40:11.536173 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Length: 0 Sep 30 19:40:11.536173 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 30 19:40:11.536173 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Host: 10.222.0.17 Sep 30 19:40:11.536173 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 30 19:40:11.536173 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 30 19:40:11.536173 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjN0ONqtIDYC2-7JPJhRMwDTFX77ua7wCzld6d05rw2OAypY6C9ruPlCf9je7iHOPQdEHBIS7fQsYNQwwCaWegqx7UtPiHvBb_B_GTauKCWL_cl9osIiSIgmJPV0ud6nFHwFaWS29rEhsSYVXTP0g-WZEwpi_MPh4YPjuB1sskH-bvyg0 Sep 30 19:40:11.536173 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 30 19:40:11.536173 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 30 19:40:11.536173 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 30 19:40:11.536173 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 30 19:40:11.536173 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 30 19:40:11.536173 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 30 19:40:11.536173 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Id: 612fb8a339e4478ba78bc5ef3b343b82 Sep 30 19:40:11.536173 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-AttachVolumeNegativeTest-1614355089 Sep 30 19:40:11.536173 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 30 19:40:11.536173 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 30 19:40:11.537719 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/612fb8a339e4478ba78bc5ef3b343b82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/612fb8a339e4478ba78bc5ef3b343b82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/612fb8a339e4478ba78bc5ef3b343b82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_612fb8a339e4478ba78bc5ef3b343b82"}]}] Sep 30 19:40:11.537719 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-AttachVolumeNegativeTest-1614355089 Sep 30 19:40:11.537719 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Id: 612fb8a339e4478ba78bc5ef3b343b82 Sep 30 19:40:11.537719 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1614355089 Sep 30 19:40:11.537719 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User: tempest-AttachVolumeNegativeTest-1614355089-project Sep 30 19:40:11.537719 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 30 19:40:11.537719 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 30 19:40:11.537719 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Id: ccbdadc310fc4bf8a6679bcb39b34ff1 Sep 30 19:40:11.537719 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-AttachVolumeNegativeTest-1614355089-project Sep 30 19:40:11.537719 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: method: > Sep 30 19:40:11.537719 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: exception: Instance 0aa829ac-05b3-4eba-89ed-39195a559ea4 could not be found. Sep 30 19:40:11.537719 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: action_args: {'id': '0aa829ac-05b3-4eba-89ed-39195a559ea4'} Sep 30 19:40:11.538665 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:40:11.538665 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:40:11.538665 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 30 19:40:11.538665 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 30 19:40:11.538665 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 30 19:40:11.538665 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 30 19:40:11.538665 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 30 19:40:11.538665 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 30 19:40:11.538665 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 30 19:40:11.538665 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 30 19:40:11.538665 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0aa829ac-05b3-4eba-89ed-39195a559ea4 could not be found. Sep 30 19:40:11.538665 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:40:11.538665 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:40:11.538665 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:40:11.538665 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:40:11.538665 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:40:11.538665 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:40:11.538665 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:40:11.538665 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:40:11.538665 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:40:11.540142 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:40:11.540142 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 30 19:40:11.540142 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 30 19:40:11.540142 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 30 19:40:11.540142 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 30 19:40:11.540142 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 30 19:40:11.540142 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 30 19:40:11.540142 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0aa829ac-05b3-4eba-89ed-39195a559ea4 could not be found. Sep 30 19:40:11.540142 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:40:11.540142 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:40:11.540142 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:40:11.540142 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:40:11.540142 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:40:11.540142 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:40:11.540142 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:40:11.540142 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:40:11.540142 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0aa829ac-05b3-4eba-89ed-39195a559ea4 could not be found. Sep 30 19:40:11.540142 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:40:11.541751 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e0fdf3bb-c863-4e96-8d20-a1a06c691e9b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Returning 404 to user: Instance 0aa829ac-05b3-4eba-89ed-39195a559ea4 could not be found. {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:40:11.541751 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-e0fdf3bb-c863-4e96-8d20-a1a06c691e9b tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/0aa829ac-05b3-4eba-89ed-39195a559ea4" status: 404 len: 111 microversion: 2.1 time: 0.030967 Sep 30 19:40:11.541751 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 497/1035] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:40:11 2022] GET /compute/v2.1/servers/0aa829ac-05b3-4eba-89ed-39195a559ea4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 30 19:40:11.546306 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-05d227a3-5743-4b8c-b8e3-66752d931392 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:40:11.546853 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-05d227a3-5743-4b8c-b8e3-66752d931392 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: e7a95413-7db3-443f-b375-3ddf2f3f6f1b] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:40:11.555720 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-05d227a3-5743-4b8c-b8e3-66752d931392 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:11.556211 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-05d227a3-5743-4b8c-b8e3-66752d931392 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:11.556759 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-05d227a3-5743-4b8c-b8e3-66752d931392 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:11.557489 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-05d227a3-5743-4b8c-b8e3-66752d931392 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:11.557960 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-05d227a3-5743-4b8c-b8e3-66752d931392 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:11.558369 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-05d227a3-5743-4b8c-b8e3-66752d931392 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:11.572717 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.wsgi [None req-05d227a3-5743-4b8c-b8e3-66752d931392 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] HTTP exception thrown: Instance e7a95413-7db3-443f-b375-3ddf2f3f6f1b could not be found. Sep 30 19:40:11.574250 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-05d227a3-5743-4b8c-b8e3-66752d931392 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Request method failure captured: Sep 30 19:40:11.574250 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: request: DELETE /compute/v2.1/servers/e7a95413-7db3-443f-b375-3ddf2f3f6f1b HTTP/1.1 Sep 30 19:40:11.574250 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Accept: application/json Sep 30 19:40:11.574250 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Accept-Encoding: identity Sep 30 19:40:11.574250 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Connection: close Sep 30 19:40:11.574250 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Content-Length: 0 Sep 30 19:40:11.574250 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Content-Type: application/json Sep 30 19:40:11.574250 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Host: 10.222.0.17 Sep 30 19:40:11.574250 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Openstack-System-Scope: None Sep 30 19:40:11.574250 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: User-Agent: python-urllib3/1.26.12 Sep 30 19:40:11.574250 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Auth-Token: gAAAAABjN0ONqtIDYC2-7JPJhRMwDTFX77ua7wCzld6d05rw2OAypY6C9ruPlCf9je7iHOPQdEHBIS7fQsYNQwwCaWegqx7UtPiHvBb_B_GTauKCWL_cl9osIiSIgmJPV0ud6nFHwFaWS29rEhsSYVXTP0g-WZEwpi_MPh4YPjuB1sskH-bvyg0 Sep 30 19:40:11.574250 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Domain-Id: None Sep 30 19:40:11.574250 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Domain-Name: None Sep 30 19:40:11.574250 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Identity-Status: Confirmed Sep 30 19:40:11.574250 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Is-Admin-Project: True Sep 30 19:40:11.574250 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Domain-Id: default Sep 30 19:40:11.574250 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Domain-Name: Default Sep 30 19:40:11.574250 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Id: 612fb8a339e4478ba78bc5ef3b343b82 Sep 30 19:40:11.574250 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Name: tempest-AttachVolumeNegativeTest-1614355089 Sep 30 19:40:11.574250 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Role: member,reader Sep 30 19:40:11.574250 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Roles: member,reader Sep 30 19:40:11.575795 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/612fb8a339e4478ba78bc5ef3b343b82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/612fb8a339e4478ba78bc5ef3b343b82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/612fb8a339e4478ba78bc5ef3b343b82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_612fb8a339e4478ba78bc5ef3b343b82"}]}] Sep 30 19:40:11.575795 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant: tempest-AttachVolumeNegativeTest-1614355089 Sep 30 19:40:11.575795 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant-Id: 612fb8a339e4478ba78bc5ef3b343b82 Sep 30 19:40:11.575795 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1614355089 Sep 30 19:40:11.575795 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User: tempest-AttachVolumeNegativeTest-1614355089-project Sep 30 19:40:11.575795 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Domain-Id: default Sep 30 19:40:11.575795 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Domain-Name: Default Sep 30 19:40:11.575795 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Id: ccbdadc310fc4bf8a6679bcb39b34ff1 Sep 30 19:40:11.575795 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Name: tempest-AttachVolumeNegativeTest-1614355089-project Sep 30 19:40:11.575795 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: method: > Sep 30 19:40:11.575795 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: exception: Instance e7a95413-7db3-443f-b375-3ddf2f3f6f1b could not be found. Sep 30 19:40:11.575795 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: action_args: {'id': 'e7a95413-7db3-443f-b375-3ddf2f3f6f1b'} Sep 30 19:40:11.576709 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:40:11.576709 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:40:11.576709 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 30 19:40:11.576709 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 30 19:40:11.576709 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 30 19:40:11.576709 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 30 19:40:11.576709 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 30 19:40:11.576709 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 30 19:40:11.576709 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 30 19:40:11.576709 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 30 19:40:11.576709 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7a95413-7db3-443f-b375-3ddf2f3f6f1b could not be found. Sep 30 19:40:11.576709 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:40:11.576709 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:40:11.576709 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:40:11.576709 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:40:11.576709 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:40:11.576709 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:40:11.576709 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:40:11.576709 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:40:11.576709 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:40:11.578997 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:40:11.578997 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 30 19:40:11.578997 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 30 19:40:11.578997 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 30 19:40:11.578997 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 30 19:40:11.578997 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 30 19:40:11.578997 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 30 19:40:11.578997 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 30 19:40:11.578997 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 30 19:40:11.578997 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7a95413-7db3-443f-b375-3ddf2f3f6f1b could not be found. Sep 30 19:40:11.578997 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:40:11.578997 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:40:11.578997 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:40:11.578997 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:40:11.578997 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:40:11.578997 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:40:11.578997 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:40:11.578997 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:40:11.578997 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7a95413-7db3-443f-b375-3ddf2f3f6f1b could not be found. Sep 30 19:40:11.578997 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:40:11.580595 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-05d227a3-5743-4b8c-b8e3-66752d931392 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Returning 404 to user: Instance e7a95413-7db3-443f-b375-3ddf2f3f6f1b could not be found. {{(pid=120649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:40:11.580595 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-05d227a3-5743-4b8c-b8e3-66752d931392 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e7a95413-7db3-443f-b375-3ddf2f3f6f1b" status: 404 len: 111 microversion: 2.1 time: 0.033242 Sep 30 19:40:11.580595 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 539/1036] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 30 19:40:11 2022] DELETE /compute/v2.1/servers/e7a95413-7db3-443f-b375-3ddf2f3f6f1b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 30 19:40:11.584732 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e0b91424-f378-47d7-8f6b-718c91efc238 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:40:11.585340 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-e0b91424-f378-47d7-8f6b-718c91efc238 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: e7a95413-7db3-443f-b375-3ddf2f3f6f1b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:40:11.591609 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e0b91424-f378-47d7-8f6b-718c91efc238 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:11.592090 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e0b91424-f378-47d7-8f6b-718c91efc238 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:11.592570 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e0b91424-f378-47d7-8f6b-718c91efc238 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:11.593308 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e0b91424-f378-47d7-8f6b-718c91efc238 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:11.593757 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e0b91424-f378-47d7-8f6b-718c91efc238 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:11.594178 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e0b91424-f378-47d7-8f6b-718c91efc238 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:11.608355 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.wsgi [None req-e0b91424-f378-47d7-8f6b-718c91efc238 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] HTTP exception thrown: Instance e7a95413-7db3-443f-b375-3ddf2f3f6f1b could not be found. Sep 30 19:40:11.609936 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e0b91424-f378-47d7-8f6b-718c91efc238 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Request method failure captured: Sep 30 19:40:11.609936 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: request: GET /compute/v2.1/servers/e7a95413-7db3-443f-b375-3ddf2f3f6f1b HTTP/1.1 Sep 30 19:40:11.609936 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 30 19:40:11.609936 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 30 19:40:11.609936 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Connection: close Sep 30 19:40:11.609936 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Length: 0 Sep 30 19:40:11.609936 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 30 19:40:11.609936 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Host: 10.222.0.17 Sep 30 19:40:11.609936 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 30 19:40:11.609936 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 30 19:40:11.609936 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjN0ONqtIDYC2-7JPJhRMwDTFX77ua7wCzld6d05rw2OAypY6C9ruPlCf9je7iHOPQdEHBIS7fQsYNQwwCaWegqx7UtPiHvBb_B_GTauKCWL_cl9osIiSIgmJPV0ud6nFHwFaWS29rEhsSYVXTP0g-WZEwpi_MPh4YPjuB1sskH-bvyg0 Sep 30 19:40:11.609936 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 30 19:40:11.609936 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 30 19:40:11.609936 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 30 19:40:11.609936 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 30 19:40:11.609936 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 30 19:40:11.609936 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 30 19:40:11.609936 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Id: 612fb8a339e4478ba78bc5ef3b343b82 Sep 30 19:40:11.609936 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-AttachVolumeNegativeTest-1614355089 Sep 30 19:40:11.609936 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 30 19:40:11.609936 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 30 19:40:11.611564 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/612fb8a339e4478ba78bc5ef3b343b82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/612fb8a339e4478ba78bc5ef3b343b82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/612fb8a339e4478ba78bc5ef3b343b82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_612fb8a339e4478ba78bc5ef3b343b82"}]}] Sep 30 19:40:11.611564 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-AttachVolumeNegativeTest-1614355089 Sep 30 19:40:11.611564 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Id: 612fb8a339e4478ba78bc5ef3b343b82 Sep 30 19:40:11.611564 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1614355089 Sep 30 19:40:11.611564 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User: tempest-AttachVolumeNegativeTest-1614355089-project Sep 30 19:40:11.611564 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 30 19:40:11.611564 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 30 19:40:11.611564 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Id: ccbdadc310fc4bf8a6679bcb39b34ff1 Sep 30 19:40:11.611564 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-AttachVolumeNegativeTest-1614355089-project Sep 30 19:40:11.611564 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: method: > Sep 30 19:40:11.611564 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: exception: Instance e7a95413-7db3-443f-b375-3ddf2f3f6f1b could not be found. Sep 30 19:40:11.611564 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: action_args: {'id': 'e7a95413-7db3-443f-b375-3ddf2f3f6f1b'} Sep 30 19:40:11.612504 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:40:11.612504 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:40:11.612504 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 30 19:40:11.612504 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 30 19:40:11.612504 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 30 19:40:11.612504 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 30 19:40:11.612504 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 30 19:40:11.612504 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 30 19:40:11.612504 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 30 19:40:11.612504 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 30 19:40:11.612504 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7a95413-7db3-443f-b375-3ddf2f3f6f1b could not be found. Sep 30 19:40:11.612504 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:40:11.612504 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:40:11.612504 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:40:11.612504 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:40:11.612504 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:40:11.612504 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:40:11.612504 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:40:11.612504 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:40:11.612504 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:40:11.613994 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:40:11.613994 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 30 19:40:11.613994 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 30 19:40:11.613994 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 30 19:40:11.613994 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 30 19:40:11.613994 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 30 19:40:11.613994 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 30 19:40:11.613994 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7a95413-7db3-443f-b375-3ddf2f3f6f1b could not be found. Sep 30 19:40:11.613994 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:40:11.613994 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:40:11.613994 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:40:11.613994 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:40:11.613994 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:40:11.613994 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:40:11.613994 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:40:11.613994 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:40:11.613994 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7a95413-7db3-443f-b375-3ddf2f3f6f1b could not be found. Sep 30 19:40:11.613994 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:40:11.615301 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e0b91424-f378-47d7-8f6b-718c91efc238 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Returning 404 to user: Instance e7a95413-7db3-443f-b375-3ddf2f3f6f1b could not be found. {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:40:11.615301 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-e0b91424-f378-47d7-8f6b-718c91efc238 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/e7a95413-7db3-443f-b375-3ddf2f3f6f1b" status: 404 len: 111 microversion: 2.1 time: 0.030372 Sep 30 19:40:11.615301 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 498/1037] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:40:11 2022] GET /compute/v2.1/servers/e7a95413-7db3-443f-b375-3ddf2f3f6f1b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 30 19:40:12.755805 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-012c2119-3c57-44cf-8ace-d8158581dcc1 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:40:12.756411 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-012c2119-3c57-44cf-8ace-d8158581dcc1 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:40:12.762759 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-012c2119-3c57-44cf-8ace-d8158581dcc1 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:12.763321 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-012c2119-3c57-44cf-8ace-d8158581dcc1 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:12.763951 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-012c2119-3c57-44cf-8ace-d8158581dcc1 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:12.764685 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-012c2119-3c57-44cf-8ace-d8158581dcc1 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:12.765143 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-012c2119-3c57-44cf-8ace-d8158581dcc1 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:12.766096 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-012c2119-3c57-44cf-8ace-d8158581dcc1 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:12.779499 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.wsgi [None req-012c2119-3c57-44cf-8ace-d8158581dcc1 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] HTTP exception thrown: Instance a84ee4e3-e6e4-4574-810f-8e5e796b4c4d could not be found. Sep 30 19:40:12.781649 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-012c2119-3c57-44cf-8ace-d8158581dcc1 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Request method failure captured: Sep 30 19:40:12.781649 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: request: DELETE /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d HTTP/1.1 Sep 30 19:40:12.781649 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Accept: application/json Sep 30 19:40:12.781649 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Accept-Encoding: identity Sep 30 19:40:12.781649 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Connection: close Sep 30 19:40:12.781649 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Content-Length: 0 Sep 30 19:40:12.781649 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Content-Type: application/json Sep 30 19:40:12.781649 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Host: 10.222.0.17 Sep 30 19:40:12.781649 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Openstack-System-Scope: None Sep 30 19:40:12.781649 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: User-Agent: python-urllib3/1.26.12 Sep 30 19:40:12.781649 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Auth-Token: gAAAAABjN0ONqtIDYC2-7JPJhRMwDTFX77ua7wCzld6d05rw2OAypY6C9ruPlCf9je7iHOPQdEHBIS7fQsYNQwwCaWegqx7UtPiHvBb_B_GTauKCWL_cl9osIiSIgmJPV0ud6nFHwFaWS29rEhsSYVXTP0g-WZEwpi_MPh4YPjuB1sskH-bvyg0 Sep 30 19:40:12.781649 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Domain-Id: None Sep 30 19:40:12.781649 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Domain-Name: None Sep 30 19:40:12.781649 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Identity-Status: Confirmed Sep 30 19:40:12.781649 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Is-Admin-Project: True Sep 30 19:40:12.781649 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Domain-Id: default Sep 30 19:40:12.781649 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Domain-Name: Default Sep 30 19:40:12.781649 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Id: 612fb8a339e4478ba78bc5ef3b343b82 Sep 30 19:40:12.781649 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Name: tempest-AttachVolumeNegativeTest-1614355089 Sep 30 19:40:12.781649 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Role: member,reader Sep 30 19:40:12.781649 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Roles: member,reader Sep 30 19:40:12.783117 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/612fb8a339e4478ba78bc5ef3b343b82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/612fb8a339e4478ba78bc5ef3b343b82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/612fb8a339e4478ba78bc5ef3b343b82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_612fb8a339e4478ba78bc5ef3b343b82"}]}] Sep 30 19:40:12.783117 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant: tempest-AttachVolumeNegativeTest-1614355089 Sep 30 19:40:12.783117 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant-Id: 612fb8a339e4478ba78bc5ef3b343b82 Sep 30 19:40:12.783117 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1614355089 Sep 30 19:40:12.783117 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User: tempest-AttachVolumeNegativeTest-1614355089-project Sep 30 19:40:12.783117 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Domain-Id: default Sep 30 19:40:12.783117 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Domain-Name: Default Sep 30 19:40:12.783117 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Id: ccbdadc310fc4bf8a6679bcb39b34ff1 Sep 30 19:40:12.783117 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Name: tempest-AttachVolumeNegativeTest-1614355089-project Sep 30 19:40:12.783117 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: method: > Sep 30 19:40:12.783117 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: exception: Instance a84ee4e3-e6e4-4574-810f-8e5e796b4c4d could not be found. Sep 30 19:40:12.783117 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: action_args: {'id': 'a84ee4e3-e6e4-4574-810f-8e5e796b4c4d'} Sep 30 19:40:12.783919 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:40:12.783919 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:40:12.783919 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 30 19:40:12.783919 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 30 19:40:12.783919 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 30 19:40:12.783919 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 30 19:40:12.783919 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 30 19:40:12.783919 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 30 19:40:12.783919 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 30 19:40:12.783919 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 30 19:40:12.783919 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a84ee4e3-e6e4-4574-810f-8e5e796b4c4d could not be found. Sep 30 19:40:12.783919 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:40:12.783919 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:40:12.783919 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:40:12.783919 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:40:12.783919 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:40:12.783919 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:40:12.783919 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:40:12.783919 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:40:12.783919 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:40:12.785585 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:40:12.785585 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 30 19:40:12.785585 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 30 19:40:12.785585 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 30 19:40:12.785585 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 30 19:40:12.785585 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 30 19:40:12.785585 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 30 19:40:12.785585 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 30 19:40:12.785585 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 30 19:40:12.785585 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a84ee4e3-e6e4-4574-810f-8e5e796b4c4d could not be found. Sep 30 19:40:12.785585 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:40:12.785585 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:40:12.785585 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:40:12.785585 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:40:12.785585 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:40:12.785585 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:40:12.785585 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:40:12.785585 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:40:12.785585 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a84ee4e3-e6e4-4574-810f-8e5e796b4c4d could not be found. Sep 30 19:40:12.785585 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:40:12.787325 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-012c2119-3c57-44cf-8ace-d8158581dcc1 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Returning 404 to user: Instance a84ee4e3-e6e4-4574-810f-8e5e796b4c4d could not be found. {{(pid=120649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:40:12.787325 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-012c2119-3c57-44cf-8ace-d8158581dcc1 tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d" status: 404 len: 111 microversion: 2.1 time: 0.031154 Sep 30 19:40:12.787325 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 540/1038] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 30 19:40:12 2022] DELETE /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 30 19:40:12.792642 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-89b885a6-d6f8-43a6-972c-92d4d5f821fa tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:40:12.793518 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-89b885a6-d6f8-43a6-972c-92d4d5f821fa tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] [instance: a84ee4e3-e6e4-4574-810f-8e5e796b4c4d] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:40:12.799950 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-89b885a6-d6f8-43a6-972c-92d4d5f821fa tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:12.800558 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-89b885a6-d6f8-43a6-972c-92d4d5f821fa tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:12.801063 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-89b885a6-d6f8-43a6-972c-92d4d5f821fa tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:12.801821 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-89b885a6-d6f8-43a6-972c-92d4d5f821fa tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:12.802347 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-89b885a6-d6f8-43a6-972c-92d4d5f821fa tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:12.802842 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-89b885a6-d6f8-43a6-972c-92d4d5f821fa tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:12.816304 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.wsgi [None req-89b885a6-d6f8-43a6-972c-92d4d5f821fa tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] HTTP exception thrown: Instance a84ee4e3-e6e4-4574-810f-8e5e796b4c4d could not be found. Sep 30 19:40:12.817937 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-89b885a6-d6f8-43a6-972c-92d4d5f821fa tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Request method failure captured: Sep 30 19:40:12.817937 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: request: GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d HTTP/1.1 Sep 30 19:40:12.817937 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 30 19:40:12.817937 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 30 19:40:12.817937 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Connection: close Sep 30 19:40:12.817937 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Length: 0 Sep 30 19:40:12.817937 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 30 19:40:12.817937 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Host: 10.222.0.17 Sep 30 19:40:12.817937 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 30 19:40:12.817937 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 30 19:40:12.817937 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjN0ONqtIDYC2-7JPJhRMwDTFX77ua7wCzld6d05rw2OAypY6C9ruPlCf9je7iHOPQdEHBIS7fQsYNQwwCaWegqx7UtPiHvBb_B_GTauKCWL_cl9osIiSIgmJPV0ud6nFHwFaWS29rEhsSYVXTP0g-WZEwpi_MPh4YPjuB1sskH-bvyg0 Sep 30 19:40:12.817937 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 30 19:40:12.817937 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 30 19:40:12.817937 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 30 19:40:12.817937 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 30 19:40:12.817937 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 30 19:40:12.817937 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 30 19:40:12.817937 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Id: 612fb8a339e4478ba78bc5ef3b343b82 Sep 30 19:40:12.817937 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-AttachVolumeNegativeTest-1614355089 Sep 30 19:40:12.817937 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 30 19:40:12.817937 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 30 19:40:12.819415 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/612fb8a339e4478ba78bc5ef3b343b82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/612fb8a339e4478ba78bc5ef3b343b82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/612fb8a339e4478ba78bc5ef3b343b82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_612fb8a339e4478ba78bc5ef3b343b82"}]}] Sep 30 19:40:12.819415 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-AttachVolumeNegativeTest-1614355089 Sep 30 19:40:12.819415 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Id: 612fb8a339e4478ba78bc5ef3b343b82 Sep 30 19:40:12.819415 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1614355089 Sep 30 19:40:12.819415 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User: tempest-AttachVolumeNegativeTest-1614355089-project Sep 30 19:40:12.819415 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 30 19:40:12.819415 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 30 19:40:12.819415 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Id: ccbdadc310fc4bf8a6679bcb39b34ff1 Sep 30 19:40:12.819415 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-AttachVolumeNegativeTest-1614355089-project Sep 30 19:40:12.819415 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: method: > Sep 30 19:40:12.819415 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: exception: Instance a84ee4e3-e6e4-4574-810f-8e5e796b4c4d could not be found. Sep 30 19:40:12.819415 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: action_args: {'id': 'a84ee4e3-e6e4-4574-810f-8e5e796b4c4d'} Sep 30 19:40:12.820246 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:40:12.820246 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:40:12.820246 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 30 19:40:12.820246 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 30 19:40:12.820246 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 30 19:40:12.820246 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 30 19:40:12.820246 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 30 19:40:12.820246 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 30 19:40:12.820246 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 30 19:40:12.820246 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 30 19:40:12.820246 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a84ee4e3-e6e4-4574-810f-8e5e796b4c4d could not be found. Sep 30 19:40:12.820246 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:40:12.820246 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:40:12.820246 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:40:12.820246 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:40:12.820246 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:40:12.820246 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:40:12.820246 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:40:12.820246 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:40:12.820246 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:40:12.821554 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:40:12.821554 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 30 19:40:12.821554 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 30 19:40:12.821554 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 30 19:40:12.821554 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 30 19:40:12.821554 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 30 19:40:12.821554 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 30 19:40:12.821554 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a84ee4e3-e6e4-4574-810f-8e5e796b4c4d could not be found. Sep 30 19:40:12.821554 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:40:12.821554 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:40:12.821554 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:40:12.821554 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:40:12.821554 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:40:12.821554 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:40:12.821554 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:40:12.821554 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:40:12.821554 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a84ee4e3-e6e4-4574-810f-8e5e796b4c4d could not be found. Sep 30 19:40:12.821554 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:40:12.823503 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-89b885a6-d6f8-43a6-972c-92d4d5f821fa tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] Returning 404 to user: Instance a84ee4e3-e6e4-4574-810f-8e5e796b4c4d could not be found. {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:40:12.823503 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-89b885a6-d6f8-43a6-972c-92d4d5f821fa tempest-AttachVolumeNegativeTest-1614355089 tempest-AttachVolumeNegativeTest-1614355089-project] 10.222.0.17 "GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d" status: 404 len: 111 microversion: 2.1 time: 0.031069 Sep 30 19:40:12.824146 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 499/1039] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:40:12 2022] GET /compute/v2.1/servers/a84ee4e3-e6e4-4574-810f-8e5e796b4c4d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 30 19:40:24.947821 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-3457e8eb-113f-45a3-ad59-d8344e34e62e tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-490342563", "imageRef": "7714d055-7d2c-4f56-9b14-45324361e286", "flavorRef": "452"}} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:40:24.955781 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_api:SELECT=11 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:40:24.956351 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:40:25.005479 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.network.neutron [None req-3457e8eb-113f-45a3-ad59-d8344e34e62e tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] validate_networks() for None {{(pid=120649) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 30 19:40:25.293400 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.virt.hardware [None req-3457e8eb-113f-45a3-ad59-d8344e34e62e tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Flavor limits 0:0:0 {{(pid=120649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 30 19:40:25.294065 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.virt.hardware [None req-3457e8eb-113f-45a3-ad59-d8344e34e62e tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Image limits 0:0:0 {{(pid=120649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 30 19:40:25.294558 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.virt.hardware [None req-3457e8eb-113f-45a3-ad59-d8344e34e62e tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Flavor pref 0:0:0 {{(pid=120649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 30 19:40:25.294977 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.virt.hardware [None req-3457e8eb-113f-45a3-ad59-d8344e34e62e tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Image pref 0:0:0 {{(pid=120649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 30 19:40:25.295396 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.virt.hardware [None req-3457e8eb-113f-45a3-ad59-d8344e34e62e tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 30 19:40:25.304051 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3457e8eb-113f-45a3-ad59-d8344e34e62e tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:25.304583 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3457e8eb-113f-45a3-ad59-d8344e34e62e tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:25.305028 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3457e8eb-113f-45a3-ad59-d8344e34e62e tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:25.305766 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3457e8eb-113f-45a3-ad59-d8344e34e62e tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:25.306229 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3457e8eb-113f-45a3-ad59-d8344e34e62e tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:25.306659 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3457e8eb-113f-45a3-ad59-d8344e34e62e tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:25.323304 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.quota [None req-3457e8eb-113f-45a3-ad59-d8344e34e62e tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Getting quotas for project fb58f1584369484f801e9fbfd0a7f6f9. Resources: {'instances', 'ram', 'cores'} {{(pid=120649) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 30 19:40:25.327552 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.quota [None req-3457e8eb-113f-45a3-ad59-d8344e34e62e tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Getting quotas for user 7ac8dd4bf0f44c768dd9ef0ef1b6f9a6 and project fb58f1584369484f801e9fbfd0a7f6f9. Resources: {'instances', 'ram', 'cores'} {{(pid=120649) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 30 19:40:25.339460 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-3457e8eb-113f-45a3-ad59-d8344e34e62e tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Going to run 1 instances... {{(pid=120649) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 30 19:40:25.341756 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-3457e8eb-113f-45a3-ad59-d8344e34e62e tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] [instance: 9814ce13-d923-446e-9e8b-880f3fc25bf4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7714d055-7d2c-4f56-9b14-45324361e286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 30 19:40:25.388477 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-3457e8eb-113f-45a3-ad59-d8344e34e62e tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.445248 Sep 30 19:40:25.389617 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 541/1040] 10.222.0.17 () {60 vars in 1147 bytes} [Fri Sep 30 19:40:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 447 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 30 19:40:25.400789 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-2a614eef-5389-450c-b4c0-818d848614ab tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:40:25.401412 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-2a614eef-5389-450c-b4c0-818d848614ab tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] [instance: 9814ce13-d923-446e-9e8b-880f3fc25bf4] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:40:25.407967 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:40:25.408825 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=62,nova_cell1:INSERT=1 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:40:25.463357 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-2a614eef-5389-450c-b4c0-818d848614ab tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac8dd4bf0f44c768dd9ef0ef1b6f9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb58f1584369484f801e9fbfd0a7f6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:40:25.470928 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-2a614eef-5389-450c-b4c0-818d848614ab tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] 10.222.0.17 "GET /compute/v2.1/servers/9814ce13-d923-446e-9e8b-880f3fc25bf4" status: 200 len: 1214 microversion: 2.1 time: 0.074337 Sep 30 19:40:25.471477 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 500/1041] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:40:25 2022] GET /compute/v2.1/servers/9814ce13-d923-446e-9e8b-880f3fc25bf4 => generated 1214 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:40:26.492603 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-460b93b5-a4e0-4b47-a1e3-1804c09d39be tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:40:26.493221 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-460b93b5-a4e0-4b47-a1e3-1804c09d39be tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] [instance: 9814ce13-d923-446e-9e8b-880f3fc25bf4] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:40:26.500286 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-460b93b5-a4e0-4b47-a1e3-1804c09d39be tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:26.500871 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-460b93b5-a4e0-4b47-a1e3-1804c09d39be tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:26.501278 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-460b93b5-a4e0-4b47-a1e3-1804c09d39be tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:26.501977 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-460b93b5-a4e0-4b47-a1e3-1804c09d39be tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:26.502447 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-460b93b5-a4e0-4b47-a1e3-1804c09d39be tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:26.502886 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-460b93b5-a4e0-4b47-a1e3-1804c09d39be tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:26.565917 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-460b93b5-a4e0-4b47-a1e3-1804c09d39be tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac8dd4bf0f44c768dd9ef0ef1b6f9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb58f1584369484f801e9fbfd0a7f6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:40:26.574040 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-460b93b5-a4e0-4b47-a1e3-1804c09d39be tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] 10.222.0.17 "GET /compute/v2.1/servers/9814ce13-d923-446e-9e8b-880f3fc25bf4" status: 200 len: 1266 microversion: 2.1 time: 0.085326 Sep 30 19:40:26.574543 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 542/1042] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:40:26 2022] GET /compute/v2.1/servers/9814ce13-d923-446e-9e8b-880f3fc25bf4 => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:40:27.602503 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-7d6f80e4-9ee2-4c7b-beb8-3c9e31695002 tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:40:27.603830 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-7d6f80e4-9ee2-4c7b-beb8-3c9e31695002 tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] [instance: 9814ce13-d923-446e-9e8b-880f3fc25bf4] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:40:27.612463 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7d6f80e4-9ee2-4c7b-beb8-3c9e31695002 tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:27.612965 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7d6f80e4-9ee2-4c7b-beb8-3c9e31695002 tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:27.613437 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7d6f80e4-9ee2-4c7b-beb8-3c9e31695002 tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:27.614148 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7d6f80e4-9ee2-4c7b-beb8-3c9e31695002 tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:27.614609 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7d6f80e4-9ee2-4c7b-beb8-3c9e31695002 tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:27.615039 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7d6f80e4-9ee2-4c7b-beb8-3c9e31695002 tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:27.759804 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-7d6f80e4-9ee2-4c7b-beb8-3c9e31695002 tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac8dd4bf0f44c768dd9ef0ef1b6f9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb58f1584369484f801e9fbfd0a7f6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:40:27.768038 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-7d6f80e4-9ee2-4c7b-beb8-3c9e31695002 tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] 10.222.0.17 "GET /compute/v2.1/servers/9814ce13-d923-446e-9e8b-880f3fc25bf4" status: 200 len: 1314 microversion: 2.1 time: 0.169423 Sep 30 19:40:27.774655 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 501/1043] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:40:27 2022] GET /compute/v2.1/servers/9814ce13-d923-446e-9e8b-880f3fc25bf4 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:40:28.181412 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [req-38221d07-3938-49e6-a5fc-9e8260584358 req-6542634a-4589-4ce4-8fc6-311ff3777e46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9814ce13-d923-446e-9e8b-880f3fc25bf4", "tag": "4f46a800-cc87-48ab-a859-f3c6b029d5b7"}]} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:40:28.195207 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-38221d07-3938-49e6-a5fc-9e8260584358 req-6542634a-4589-4ce4-8fc6-311ff3777e46 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:28.196086 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-38221d07-3938-49e6-a5fc-9e8260584358 req-6542634a-4589-4ce4-8fc6-311ff3777e46 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:28.196734 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-38221d07-3938-49e6-a5fc-9e8260584358 req-6542634a-4589-4ce4-8fc6-311ff3777e46 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:28.211159 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.compute.server_external_events [req-38221d07-3938-49e6-a5fc-9e8260584358 req-6542634a-4589-4ce4-8fc6-311ff3777e46 service nova] Creating event network-changed:4f46a800-cc87-48ab-a859-f3c6b029d5b7 for instance 9814ce13-d923-446e-9e8b-880f3fc25bf4 on hv-cinder-86001 Sep 30 19:40:28.216180 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [req-38221d07-3938-49e6-a5fc-9e8260584358 req-6542634a-4589-4ce4-8fc6-311ff3777e46 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038651 Sep 30 19:40:28.217315 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 543/1044] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:40:28.791315 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-000bee41-1f0f-410d-9a65-edd07fa18cc9 tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:40:28.791919 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-000bee41-1f0f-410d-9a65-edd07fa18cc9 tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] [instance: 9814ce13-d923-446e-9e8b-880f3fc25bf4] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:40:28.798392 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-000bee41-1f0f-410d-9a65-edd07fa18cc9 tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:28.798873 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-000bee41-1f0f-410d-9a65-edd07fa18cc9 tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:28.799304 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-000bee41-1f0f-410d-9a65-edd07fa18cc9 tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:28.799984 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-000bee41-1f0f-410d-9a65-edd07fa18cc9 tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:28.800467 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-000bee41-1f0f-410d-9a65-edd07fa18cc9 tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:28.800894 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-000bee41-1f0f-410d-9a65-edd07fa18cc9 tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:28.925114 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-000bee41-1f0f-410d-9a65-edd07fa18cc9 tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac8dd4bf0f44c768dd9ef0ef1b6f9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb58f1584369484f801e9fbfd0a7f6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:40:28.932612 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-000bee41-1f0f-410d-9a65-edd07fa18cc9 tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] 10.222.0.17 "GET /compute/v2.1/servers/9814ce13-d923-446e-9e8b-880f3fc25bf4" status: 200 len: 1314 microversion: 2.1 time: 0.145162 Sep 30 19:40:28.933167 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 502/1045] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:40:28 2022] GET /compute/v2.1/servers/9814ce13-d923-446e-9e8b-880f3fc25bf4 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:40:29.958732 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-6e1d40bd-0d8c-42b7-8337-63feaa7d55f5 tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:40:29.959439 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-6e1d40bd-0d8c-42b7-8337-63feaa7d55f5 tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] [instance: 9814ce13-d923-446e-9e8b-880f3fc25bf4] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:40:29.969547 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6e1d40bd-0d8c-42b7-8337-63feaa7d55f5 tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:29.970056 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6e1d40bd-0d8c-42b7-8337-63feaa7d55f5 tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:29.970506 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6e1d40bd-0d8c-42b7-8337-63feaa7d55f5 tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:29.971209 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6e1d40bd-0d8c-42b7-8337-63feaa7d55f5 tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:29.971671 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6e1d40bd-0d8c-42b7-8337-63feaa7d55f5 tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:29.972119 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6e1d40bd-0d8c-42b7-8337-63feaa7d55f5 tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:30.109820 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-6e1d40bd-0d8c-42b7-8337-63feaa7d55f5 tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac8dd4bf0f44c768dd9ef0ef1b6f9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb58f1584369484f801e9fbfd0a7f6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:40:30.117865 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-6e1d40bd-0d8c-42b7-8337-63feaa7d55f5 tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] 10.222.0.17 "GET /compute/v2.1/servers/9814ce13-d923-446e-9e8b-880f3fc25bf4" status: 200 len: 1314 microversion: 2.1 time: 0.163172 Sep 30 19:40:30.118430 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 544/1046] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:40:29 2022] GET /compute/v2.1/servers/9814ce13-d923-446e-9e8b-880f3fc25bf4 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:40:31.141066 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-85a95b85-f8f7-4b89-bfb3-1ddbe7732827 tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:40:31.142297 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-85a95b85-f8f7-4b89-bfb3-1ddbe7732827 tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] [instance: 9814ce13-d923-446e-9e8b-880f3fc25bf4] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:40:31.149594 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-85a95b85-f8f7-4b89-bfb3-1ddbe7732827 tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:31.150086 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-85a95b85-f8f7-4b89-bfb3-1ddbe7732827 tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:31.150521 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-85a95b85-f8f7-4b89-bfb3-1ddbe7732827 tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:31.151222 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-85a95b85-f8f7-4b89-bfb3-1ddbe7732827 tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:31.151852 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-85a95b85-f8f7-4b89-bfb3-1ddbe7732827 tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:31.152301 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-85a95b85-f8f7-4b89-bfb3-1ddbe7732827 tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:31.334259 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-85a95b85-f8f7-4b89-bfb3-1ddbe7732827 tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac8dd4bf0f44c768dd9ef0ef1b6f9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb58f1584369484f801e9fbfd0a7f6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:40:31.345065 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-85a95b85-f8f7-4b89-bfb3-1ddbe7732827 tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] 10.222.0.17 "GET /compute/v2.1/servers/9814ce13-d923-446e-9e8b-880f3fc25bf4" status: 200 len: 1314 microversion: 2.1 time: 0.206126 Sep 30 19:40:31.346673 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 503/1047] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:40:31 2022] GET /compute/v2.1/servers/9814ce13-d923-446e-9e8b-880f3fc25bf4 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:40:32.369352 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-eebd042d-e11a-4aa3-a594-49dbf9e782ab tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:40:32.370049 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-eebd042d-e11a-4aa3-a594-49dbf9e782ab tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] [instance: 9814ce13-d923-446e-9e8b-880f3fc25bf4] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:40:32.377046 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-eebd042d-e11a-4aa3-a594-49dbf9e782ab tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:32.377599 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-eebd042d-e11a-4aa3-a594-49dbf9e782ab tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:32.378123 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-eebd042d-e11a-4aa3-a594-49dbf9e782ab tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:32.378882 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-eebd042d-e11a-4aa3-a594-49dbf9e782ab tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:32.379409 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-eebd042d-e11a-4aa3-a594-49dbf9e782ab tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:32.379902 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-eebd042d-e11a-4aa3-a594-49dbf9e782ab tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:32.575321 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-eebd042d-e11a-4aa3-a594-49dbf9e782ab tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac8dd4bf0f44c768dd9ef0ef1b6f9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb58f1584369484f801e9fbfd0a7f6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:40:32.582916 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-eebd042d-e11a-4aa3-a594-49dbf9e782ab tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] 10.222.0.17 "GET /compute/v2.1/servers/9814ce13-d923-446e-9e8b-880f3fc25bf4" status: 200 len: 1314 microversion: 2.1 time: 0.217419 Sep 30 19:40:32.583481 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 545/1048] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:40:32 2022] GET /compute/v2.1/servers/9814ce13-d923-446e-9e8b-880f3fc25bf4 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:40:33.377971 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-03ce33f5-5060-405e-bee0-c59d61f83522 req-8bd80401-de30-4b49-b524-8247845b0a4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9814ce13-d923-446e-9e8b-880f3fc25bf4", "name": "network-vif-plugged", "status": "completed", "tag": "4f46a800-cc87-48ab-a859-f3c6b029d5b7"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:40:33.387857 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-03ce33f5-5060-405e-bee0-c59d61f83522 req-8bd80401-de30-4b49-b524-8247845b0a4c service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:33.391651 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-03ce33f5-5060-405e-bee0-c59d61f83522 req-8bd80401-de30-4b49-b524-8247845b0a4c service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:33.392215 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-03ce33f5-5060-405e-bee0-c59d61f83522 req-8bd80401-de30-4b49-b524-8247845b0a4c service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:33.409008 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-03ce33f5-5060-405e-bee0-c59d61f83522 req-8bd80401-de30-4b49-b524-8247845b0a4c service nova] Creating event network-vif-plugged:4f46a800-cc87-48ab-a859-f3c6b029d5b7 for instance 9814ce13-d923-446e-9e8b-880f3fc25bf4 on hv-cinder-86001 Sep 30 19:40:33.414495 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-03ce33f5-5060-405e-bee0-c59d61f83522 req-8bd80401-de30-4b49-b524-8247845b0a4c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169878 Sep 30 19:40:33.415523 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 504/1049] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:40:33.607090 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-afa80548-4241-479a-96f9-36e8425cc360 tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:40:33.608842 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-afa80548-4241-479a-96f9-36e8425cc360 tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] [instance: 9814ce13-d923-446e-9e8b-880f3fc25bf4] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:40:33.616520 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-afa80548-4241-479a-96f9-36e8425cc360 tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:33.617093 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-afa80548-4241-479a-96f9-36e8425cc360 tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:33.617620 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-afa80548-4241-479a-96f9-36e8425cc360 tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:33.618536 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-afa80548-4241-479a-96f9-36e8425cc360 tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:33.619112 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-afa80548-4241-479a-96f9-36e8425cc360 tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:33.619831 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-afa80548-4241-479a-96f9-36e8425cc360 tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:33.769433 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-afa80548-4241-479a-96f9-36e8425cc360 tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac8dd4bf0f44c768dd9ef0ef1b6f9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb58f1584369484f801e9fbfd0a7f6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:40:33.777648 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-afa80548-4241-479a-96f9-36e8425cc360 tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] 10.222.0.17 "GET /compute/v2.1/servers/9814ce13-d923-446e-9e8b-880f3fc25bf4" status: 200 len: 1314 microversion: 2.1 time: 0.174503 Sep 30 19:40:33.778300 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 546/1050] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:40:33 2022] GET /compute/v2.1/servers/9814ce13-d923-446e-9e8b-880f3fc25bf4 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:40:34.802157 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-0e2bc3f2-ca3d-4f58-a901-f9cbfe19d56a tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:40:34.802909 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-0e2bc3f2-ca3d-4f58-a901-f9cbfe19d56a tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] [instance: 9814ce13-d923-446e-9e8b-880f3fc25bf4] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:40:34.809029 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0e2bc3f2-ca3d-4f58-a901-f9cbfe19d56a tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:34.809517 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0e2bc3f2-ca3d-4f58-a901-f9cbfe19d56a tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:34.809967 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0e2bc3f2-ca3d-4f58-a901-f9cbfe19d56a tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:34.810660 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0e2bc3f2-ca3d-4f58-a901-f9cbfe19d56a tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:34.811121 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0e2bc3f2-ca3d-4f58-a901-f9cbfe19d56a tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:34.811553 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0e2bc3f2-ca3d-4f58-a901-f9cbfe19d56a tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:34.941665 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-0e2bc3f2-ca3d-4f58-a901-f9cbfe19d56a tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac8dd4bf0f44c768dd9ef0ef1b6f9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb58f1584369484f801e9fbfd0a7f6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:40:34.949124 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-0e2bc3f2-ca3d-4f58-a901-f9cbfe19d56a tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] 10.222.0.17 "GET /compute/v2.1/servers/9814ce13-d923-446e-9e8b-880f3fc25bf4" status: 200 len: 1314 microversion: 2.1 time: 0.151718 Sep 30 19:40:34.949725 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 505/1051] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:40:34 2022] GET /compute/v2.1/servers/9814ce13-d923-446e-9e8b-880f3fc25bf4 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:40:35.973442 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-7cb84706-4cec-4d70-a40e-bf8fee5fb4ac tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:40:35.974046 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-7cb84706-4cec-4d70-a40e-bf8fee5fb4ac tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] [instance: 9814ce13-d923-446e-9e8b-880f3fc25bf4] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:40:35.976678 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell0:SELECT=2 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:40:35.977336 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell0:SELECT=6 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:40:35.983264 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7cb84706-4cec-4d70-a40e-bf8fee5fb4ac tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:35.983746 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7cb84706-4cec-4d70-a40e-bf8fee5fb4ac tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:35.984185 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7cb84706-4cec-4d70-a40e-bf8fee5fb4ac tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:35.985111 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7cb84706-4cec-4d70-a40e-bf8fee5fb4ac tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:35.985790 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7cb84706-4cec-4d70-a40e-bf8fee5fb4ac tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:35.986192 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7cb84706-4cec-4d70-a40e-bf8fee5fb4ac tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:36.120996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-7cb84706-4cec-4d70-a40e-bf8fee5fb4ac tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac8dd4bf0f44c768dd9ef0ef1b6f9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb58f1584369484f801e9fbfd0a7f6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:40:36.129125 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-7cb84706-4cec-4d70-a40e-bf8fee5fb4ac tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] 10.222.0.17 "GET /compute/v2.1/servers/9814ce13-d923-446e-9e8b-880f3fc25bf4" status: 200 len: 1464 microversion: 2.1 time: 0.160506 Sep 30 19:40:36.129686 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 547/1052] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:40:35 2022] GET /compute/v2.1/servers/9814ce13-d923-446e-9e8b-880f3fc25bf4 => generated 1464 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:40:36.181117 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-28c51745-688e-43f8-a5e9-340871f00d6f tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:40:36.181613 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-28c51745-688e-43f8-a5e9-340871f00d6f tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] [instance: 9814ce13-d923-446e-9e8b-880f3fc25bf4] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:40:36.184608 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=2 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:40:36.189133 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-28c51745-688e-43f8-a5e9-340871f00d6f tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:36.189650 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-28c51745-688e-43f8-a5e9-340871f00d6f tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:36.190167 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-28c51745-688e-43f8-a5e9-340871f00d6f tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:36.190864 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-28c51745-688e-43f8-a5e9-340871f00d6f tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:36.191321 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-28c51745-688e-43f8-a5e9-340871f00d6f tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:36.191766 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-28c51745-688e-43f8-a5e9-340871f00d6f tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:36.219006 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-28c51745-688e-43f8-a5e9-340871f00d6f tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] [instance: 9814ce13-d923-446e-9e8b-880f3fc25bf4] Going to try to terminate instance {{(pid=120648) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 30 19:40:36.304992 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-28c51745-688e-43f8-a5e9-340871f00d6f tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] 10.222.0.17 "DELETE /compute/v2.1/servers/9814ce13-d923-446e-9e8b-880f3fc25bf4" status: 204 len: 0 microversion: 2.1 time: 0.127315 Sep 30 19:40:36.305964 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 506/1053] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 30 19:40:36 2022] DELETE /compute/v2.1/servers/9814ce13-d923-446e-9e8b-880f3fc25bf4 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 30 19:40:36.317158 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-067f3d30-8360-47ca-a938-4db6525fb6cb tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:40:36.318300 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-067f3d30-8360-47ca-a938-4db6525fb6cb tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] [instance: 9814ce13-d923-446e-9e8b-880f3fc25bf4] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:40:36.325852 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-067f3d30-8360-47ca-a938-4db6525fb6cb tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:36.326506 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-067f3d30-8360-47ca-a938-4db6525fb6cb tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:36.327134 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-067f3d30-8360-47ca-a938-4db6525fb6cb tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:36.327945 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-067f3d30-8360-47ca-a938-4db6525fb6cb tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:36.328582 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-067f3d30-8360-47ca-a938-4db6525fb6cb tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:36.329130 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-067f3d30-8360-47ca-a938-4db6525fb6cb tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:36.482970 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-067f3d30-8360-47ca-a938-4db6525fb6cb tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac8dd4bf0f44c768dd9ef0ef1b6f9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb58f1584369484f801e9fbfd0a7f6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:40:36.491051 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-067f3d30-8360-47ca-a938-4db6525fb6cb tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] 10.222.0.17 "GET /compute/v2.1/servers/9814ce13-d923-446e-9e8b-880f3fc25bf4" status: 200 len: 1470 microversion: 2.1 time: 0.179795 Sep 30 19:40:36.491616 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 548/1054] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:40:36 2022] GET /compute/v2.1/servers/9814ce13-d923-446e-9e8b-880f3fc25bf4 => generated 1470 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:40:37.514924 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-f4490611-f8d4-4cec-a7a1-f97757914c59 tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:40:37.515547 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-f4490611-f8d4-4cec-a7a1-f97757914c59 tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] [instance: 9814ce13-d923-446e-9e8b-880f3fc25bf4] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:40:37.522044 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f4490611-f8d4-4cec-a7a1-f97757914c59 tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:37.522516 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f4490611-f8d4-4cec-a7a1-f97757914c59 tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:37.522938 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f4490611-f8d4-4cec-a7a1-f97757914c59 tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:37.523614 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f4490611-f8d4-4cec-a7a1-f97757914c59 tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:37.524063 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f4490611-f8d4-4cec-a7a1-f97757914c59 tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:37.524508 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f4490611-f8d4-4cec-a7a1-f97757914c59 tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:37.655960 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f4490611-f8d4-4cec-a7a1-f97757914c59 tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac8dd4bf0f44c768dd9ef0ef1b6f9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb58f1584369484f801e9fbfd0a7f6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:40:37.663913 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-f4490611-f8d4-4cec-a7a1-f97757914c59 tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] 10.222.0.17 "GET /compute/v2.1/servers/9814ce13-d923-446e-9e8b-880f3fc25bf4" status: 200 len: 1470 microversion: 2.1 time: 0.153240 Sep 30 19:40:37.664506 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 507/1055] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:40:37 2022] GET /compute/v2.1/servers/9814ce13-d923-446e-9e8b-880f3fc25bf4 => generated 1470 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:40:38.691444 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-dd72b89c-b14d-4f1a-af4f-77ad054a6daf req-899170de-943b-4ad8-b480-f1aba70545e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9814ce13-d923-446e-9e8b-880f3fc25bf4", "name": "network-vif-deleted", "tag": "4f46a800-cc87-48ab-a859-f3c6b029d5b7"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:40:38.693473 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-89d18156-8938-499f-ba3d-ca6ea7bc26ed tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:40:38.694610 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-89d18156-8938-499f-ba3d-ca6ea7bc26ed tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] [instance: 9814ce13-d923-446e-9e8b-880f3fc25bf4] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:40:38.702649 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-89d18156-8938-499f-ba3d-ca6ea7bc26ed tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:38.703142 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-89d18156-8938-499f-ba3d-ca6ea7bc26ed tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:38.703399 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-dd72b89c-b14d-4f1a-af4f-77ad054a6daf req-899170de-943b-4ad8-b480-f1aba70545e0 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:38.703583 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-89d18156-8938-499f-ba3d-ca6ea7bc26ed tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:38.703877 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-dd72b89c-b14d-4f1a-af4f-77ad054a6daf req-899170de-943b-4ad8-b480-f1aba70545e0 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:38.704820 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-89d18156-8938-499f-ba3d-ca6ea7bc26ed tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:38.704931 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-dd72b89c-b14d-4f1a-af4f-77ad054a6daf req-899170de-943b-4ad8-b480-f1aba70545e0 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:38.705283 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-89d18156-8938-499f-ba3d-ca6ea7bc26ed tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:38.705710 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-89d18156-8938-499f-ba3d-ca6ea7bc26ed tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:38.717178 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-dd72b89c-b14d-4f1a-af4f-77ad054a6daf req-899170de-943b-4ad8-b480-f1aba70545e0 service nova] Creating event network-vif-deleted:4f46a800-cc87-48ab-a859-f3c6b029d5b7 for instance 9814ce13-d923-446e-9e8b-880f3fc25bf4 on hv-cinder-86001 Sep 30 19:40:38.723158 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-dd72b89c-b14d-4f1a-af4f-77ad054a6daf req-899170de-943b-4ad8-b480-f1aba70545e0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035187 Sep 30 19:40:38.724854 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 508/1056] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:40:38.788465 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-89d18156-8938-499f-ba3d-ca6ea7bc26ed tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac8dd4bf0f44c768dd9ef0ef1b6f9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb58f1584369484f801e9fbfd0a7f6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:40:38.797299 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-89d18156-8938-499f-ba3d-ca6ea7bc26ed tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] 10.222.0.17 "GET /compute/v2.1/servers/9814ce13-d923-446e-9e8b-880f3fc25bf4" status: 200 len: 1428 microversion: 2.1 time: 0.113834 Sep 30 19:40:38.798177 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 549/1057] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:40:38 2022] GET /compute/v2.1/servers/9814ce13-d923-446e-9e8b-880f3fc25bf4 => generated 1428 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:40:39.822629 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-cd357503-39dd-4d41-b1e8-56766340299c tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:40:39.823317 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-cd357503-39dd-4d41-b1e8-56766340299c tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] [instance: 9814ce13-d923-446e-9e8b-880f3fc25bf4] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:40:39.829295 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cd357503-39dd-4d41-b1e8-56766340299c tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:39.829768 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cd357503-39dd-4d41-b1e8-56766340299c tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:39.830194 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cd357503-39dd-4d41-b1e8-56766340299c tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:39.830876 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cd357503-39dd-4d41-b1e8-56766340299c tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:39.831325 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cd357503-39dd-4d41-b1e8-56766340299c tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:39.831751 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cd357503-39dd-4d41-b1e8-56766340299c tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:39.844514 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.wsgi [None req-cd357503-39dd-4d41-b1e8-56766340299c tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] HTTP exception thrown: Instance 9814ce13-d923-446e-9e8b-880f3fc25bf4 could not be found. Sep 30 19:40:39.846595 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-cd357503-39dd-4d41-b1e8-56766340299c tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Request method failure captured: Sep 30 19:40:39.846595 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: request: GET /compute/v2.1/servers/9814ce13-d923-446e-9e8b-880f3fc25bf4 HTTP/1.1 Sep 30 19:40:39.846595 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 30 19:40:39.846595 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 30 19:40:39.846595 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Connection: close Sep 30 19:40:39.846595 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Length: 0 Sep 30 19:40:39.846595 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 30 19:40:39.846595 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Host: 10.222.0.17 Sep 30 19:40:39.846595 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 30 19:40:39.846595 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 30 19:40:39.846595 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjN0YncU8jpp2fLpe2ZSKmdNnxYsn8Dy7IL3lleRu0h37ZSC0B3pYFQRJ7_lhW1jbJHr1GwkTEUDwfkzSQlHJMumM1P2izsOxRFFiUmmRIUvePAvRh-8E4YHvlclYHUuD1pmDOYwn_ocB1K3F37CTpNWnbBuKUnDZ7cDc8JhYgzgyF-7Y Sep 30 19:40:39.846595 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 30 19:40:39.846595 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 30 19:40:39.846595 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 30 19:40:39.846595 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 30 19:40:39.846595 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 30 19:40:39.846595 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 30 19:40:39.846595 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Id: fb58f1584369484f801e9fbfd0a7f6f9 Sep 30 19:40:39.846595 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-VolumesNegativeTest-1608991462 Sep 30 19:40:39.846595 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 30 19:40:39.846595 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 30 19:40:39.848174 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fb58f1584369484f801e9fbfd0a7f6f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fb58f1584369484f801e9fbfd0a7f6f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fb58f1584369484f801e9fbfd0a7f6f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fb58f1584369484f801e9fbfd0a7f6f9"}]}] Sep 30 19:40:39.848174 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-VolumesNegativeTest-1608991462 Sep 30 19:40:39.848174 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Id: fb58f1584369484f801e9fbfd0a7f6f9 Sep 30 19:40:39.848174 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-VolumesNegativeTest-1608991462 Sep 30 19:40:39.848174 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User: tempest-VolumesNegativeTest-1608991462-project Sep 30 19:40:39.848174 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 30 19:40:39.848174 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 30 19:40:39.848174 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Id: 7ac8dd4bf0f44c768dd9ef0ef1b6f9a6 Sep 30 19:40:39.848174 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-VolumesNegativeTest-1608991462-project Sep 30 19:40:39.848174 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: method: > Sep 30 19:40:39.848174 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: exception: Instance 9814ce13-d923-446e-9e8b-880f3fc25bf4 could not be found. Sep 30 19:40:39.848174 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: action_args: {'id': '9814ce13-d923-446e-9e8b-880f3fc25bf4'} Sep 30 19:40:39.849171 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:40:39.849171 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:40:39.849171 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 30 19:40:39.849171 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 30 19:40:39.849171 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 30 19:40:39.849171 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 30 19:40:39.849171 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 30 19:40:39.849171 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 30 19:40:39.849171 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 30 19:40:39.849171 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 30 19:40:39.849171 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9814ce13-d923-446e-9e8b-880f3fc25bf4 could not be found. Sep 30 19:40:39.849171 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:40:39.849171 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:40:39.849171 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:40:39.849171 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:40:39.849171 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:40:39.849171 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:40:39.849171 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:40:39.849171 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:40:39.849171 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:40:39.850683 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:40:39.850683 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 30 19:40:39.850683 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 30 19:40:39.850683 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 30 19:40:39.850683 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 30 19:40:39.850683 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 30 19:40:39.850683 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 30 19:40:39.850683 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9814ce13-d923-446e-9e8b-880f3fc25bf4 could not be found. Sep 30 19:40:39.850683 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:40:39.850683 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:40:39.850683 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:40:39.850683 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:40:39.850683 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:40:39.850683 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:40:39.850683 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:40:39.850683 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:40:39.850683 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9814ce13-d923-446e-9e8b-880f3fc25bf4 could not be found. Sep 30 19:40:39.850683 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:40:39.851990 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-cd357503-39dd-4d41-b1e8-56766340299c tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] Returning 404 to user: Instance 9814ce13-d923-446e-9e8b-880f3fc25bf4 could not be found. {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:40:39.851990 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-cd357503-39dd-4d41-b1e8-56766340299c tempest-VolumesNegativeTest-1608991462 tempest-VolumesNegativeTest-1608991462-project] 10.222.0.17 "GET /compute/v2.1/servers/9814ce13-d923-446e-9e8b-880f3fc25bf4" status: 404 len: 111 microversion: 2.1 time: 0.029984 Sep 30 19:40:39.851990 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 509/1058] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:40:39 2022] GET /compute/v2.1/servers/9814ce13-d923-446e-9e8b-880f3fc25bf4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 30 19:40:42.457622 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-5969d4d1-6990-44c8-bcc4-4769250ab7b9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:40:42.460391 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-5969d4d1-6990-44c8-bcc4-4769250ab7b9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:40:42.469538 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5969d4d1-6990-44c8-bcc4-4769250ab7b9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:42.470394 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5969d4d1-6990-44c8-bcc4-4769250ab7b9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:42.471054 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5969d4d1-6990-44c8-bcc4-4769250ab7b9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:42.472619 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5969d4d1-6990-44c8-bcc4-4769250ab7b9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:42.473347 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5969d4d1-6990-44c8-bcc4-4769250ab7b9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:42.474001 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5969d4d1-6990-44c8-bcc4-4769250ab7b9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:42.514165 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-5969d4d1-6990-44c8-bcc4-4769250ab7b9 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.061442 Sep 30 19:40:42.514794 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 550/1059] 10.222.0.17 () {60 vars in 1343 bytes} [Fri Sep 30 19:40:42 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:40:42.581116 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-5b4fc08a-7229-4550-89c9-9ddfe312c534 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:40:42.581693 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-5b4fc08a-7229-4550-89c9-9ddfe312c534 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:40:42.587933 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5b4fc08a-7229-4550-89c9-9ddfe312c534 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:42.588439 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5b4fc08a-7229-4550-89c9-9ddfe312c534 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:42.588892 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5b4fc08a-7229-4550-89c9-9ddfe312c534 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:42.589569 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5b4fc08a-7229-4550-89c9-9ddfe312c534 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:42.590023 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5b4fc08a-7229-4550-89c9-9ddfe312c534 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:42.590445 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5b4fc08a-7229-4550-89c9-9ddfe312c534 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:42.622312 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-5b4fc08a-7229-4550-89c9-9ddfe312c534 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Going to try to terminate instance {{(pid=120648) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 30 19:40:42.714937 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-5b4fc08a-7229-4550-89c9-9ddfe312c534 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "DELETE /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 204 len: 0 microversion: 2.20 time: 0.137399 Sep 30 19:40:42.715508 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 510/1060] 10.222.0.17 () {60 vars in 1280 bytes} [Fri Sep 30 19:40:42 2022] DELETE /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 30 19:40:42.723812 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-83770e17-e39b-484b-a459-2ed97342fe85 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:40:42.724454 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-83770e17-e39b-484b-a459-2ed97342fe85 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:40:42.730926 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-83770e17-e39b-484b-a459-2ed97342fe85 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:42.731417 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-83770e17-e39b-484b-a459-2ed97342fe85 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:42.731966 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-83770e17-e39b-484b-a459-2ed97342fe85 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:42.732722 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-83770e17-e39b-484b-a459-2ed97342fe85 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:42.733134 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-83770e17-e39b-484b-a459-2ed97342fe85 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:42.733560 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-83770e17-e39b-484b-a459-2ed97342fe85 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:42.883579 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-83770e17-e39b-484b-a459-2ed97342fe85 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:40:42.893225 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-83770e17-e39b-484b-a459-2ed97342fe85 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:40:42.895038 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-83770e17-e39b-484b-a459-2ed97342fe85 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:40:42.897985 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-83770e17-e39b-484b-a459-2ed97342fe85 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1720 microversion: 2.20 time: 0.178334 Sep 30 19:40:42.898544 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 551/1061] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:40:42 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1720 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:40:43.925983 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-8a5772a8-78b7-4202-a392-b08e5a882bce tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:40:43.926688 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-8a5772a8-78b7-4202-a392-b08e5a882bce tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:40:43.933134 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8a5772a8-78b7-4202-a392-b08e5a882bce tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:43.933750 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8a5772a8-78b7-4202-a392-b08e5a882bce tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:43.934267 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8a5772a8-78b7-4202-a392-b08e5a882bce tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:43.935204 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8a5772a8-78b7-4202-a392-b08e5a882bce tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:43.935833 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8a5772a8-78b7-4202-a392-b08e5a882bce tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:43.936466 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8a5772a8-78b7-4202-a392-b08e5a882bce tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:44.070459 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-8a5772a8-78b7-4202-a392-b08e5a882bce tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:40:44.079187 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-8a5772a8-78b7-4202-a392-b08e5a882bce tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:40:44.080664 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-8a5772a8-78b7-4202-a392-b08e5a882bce tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:40:44.081878 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-8a5772a8-78b7-4202-a392-b08e5a882bce tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1720 microversion: 2.20 time: 0.160201 Sep 30 19:40:44.082447 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 511/1062] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:40:43 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 30 19:40:45.107767 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-a0c62302-74c7-477f-834b-c5d60524603d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:40:45.108243 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-a0c62302-74c7-477f-834b-c5d60524603d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:40:45.121076 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a0c62302-74c7-477f-834b-c5d60524603d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:45.121576 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a0c62302-74c7-477f-834b-c5d60524603d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:45.122026 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a0c62302-74c7-477f-834b-c5d60524603d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:45.122868 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a0c62302-74c7-477f-834b-c5d60524603d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:45.123271 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a0c62302-74c7-477f-834b-c5d60524603d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:45.128264 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a0c62302-74c7-477f-834b-c5d60524603d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:45.215041 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-a0c62302-74c7-477f-834b-c5d60524603d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:40:45.226060 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-a0c62302-74c7-477f-834b-c5d60524603d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:40:45.228137 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-a0c62302-74c7-477f-834b-c5d60524603d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7aa40f3966d4c97ab6a1a764722969d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395bb9b09f7948bbad5817c88aa4accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:40:45.229779 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-a0c62302-74c7-477f-834b-c5d60524603d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 200 len: 1653 microversion: 2.20 time: 0.126323 Sep 30 19:40:45.230676 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 552/1063] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:40:45 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 1653 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 30 19:40:45.668098 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-fc636b92-8fb2-428d-a204-2ef97586c5a9 req-e91e1204-1b16-46fc-b06b-7f642425900a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67a09687-3d87-4069-b17c-6ed9b6e96700", "name": "network-vif-deleted", "tag": "c71e45c4-5abc-49db-8f88-3b7e95572f59"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:40:45.690010 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-fc636b92-8fb2-428d-a204-2ef97586c5a9 req-e91e1204-1b16-46fc-b06b-7f642425900a service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:45.690507 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-fc636b92-8fb2-428d-a204-2ef97586c5a9 req-e91e1204-1b16-46fc-b06b-7f642425900a service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:45.690945 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-fc636b92-8fb2-428d-a204-2ef97586c5a9 req-e91e1204-1b16-46fc-b06b-7f642425900a service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:45.712583 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-fc636b92-8fb2-428d-a204-2ef97586c5a9 req-e91e1204-1b16-46fc-b06b-7f642425900a service nova] Creating event network-vif-deleted:c71e45c4-5abc-49db-8f88-3b7e95572f59 for instance 67a09687-3d87-4069-b17c-6ed9b6e96700 on hv-cinder-86001 Sep 30 19:40:45.718801 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-fc636b92-8fb2-428d-a204-2ef97586c5a9 req-e91e1204-1b16-46fc-b06b-7f642425900a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.245920 Sep 30 19:40:45.719657 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 512/1064] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:40:46.267920 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-db031fd6-c458-4a80-9fab-4e50dfec8fa0 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:40:46.268640 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-db031fd6-c458-4a80-9fab-4e50dfec8fa0 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:40:46.276219 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-db031fd6-c458-4a80-9fab-4e50dfec8fa0 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:46.277447 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-db031fd6-c458-4a80-9fab-4e50dfec8fa0 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:46.278876 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-db031fd6-c458-4a80-9fab-4e50dfec8fa0 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:46.279769 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-db031fd6-c458-4a80-9fab-4e50dfec8fa0 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:46.280591 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-db031fd6-c458-4a80-9fab-4e50dfec8fa0 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:46.281097 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-db031fd6-c458-4a80-9fab-4e50dfec8fa0 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:46.296388 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.wsgi [None req-db031fd6-c458-4a80-9fab-4e50dfec8fa0 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] HTTP exception thrown: Instance 67a09687-3d87-4069-b17c-6ed9b6e96700 could not be found. Sep 30 19:40:46.298135 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-db031fd6-c458-4a80-9fab-4e50dfec8fa0 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Request method failure captured: Sep 30 19:40:46.298135 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: request: GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 HTTP/1.1 Sep 30 19:40:46.298135 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Accept: application/json Sep 30 19:40:46.298135 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Accept-Encoding: identity Sep 30 19:40:46.298135 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Connection: close Sep 30 19:40:46.298135 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Content-Length: 0 Sep 30 19:40:46.298135 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Content-Type: application/json Sep 30 19:40:46.298135 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Host: 10.222.0.17 Sep 30 19:40:46.298135 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Openstack-System-Scope: None Sep 30 19:40:46.298135 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: User-Agent: python-urllib3/1.26.12 Sep 30 19:40:46.298135 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Auth-Token: gAAAAABjN0ONOwIbxc91xU7l52C5Fy5ArsRt6ZX45qakD2SHqVzbm57ZiOsFY9DJEc7VM20VbNzf_nMkRzugCjpggS9pLU0vkBtv9Nb8dhUHNADVjRcXlSEqEvNvAzNcvlBQ5lqdZ11HA75fhmXNMWOsHwjHRW6QioUNPVnYNgMj-6Kfcx2lCKY Sep 30 19:40:46.298135 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Domain-Id: None Sep 30 19:40:46.298135 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Domain-Name: None Sep 30 19:40:46.298135 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Identity-Status: Confirmed Sep 30 19:40:46.298135 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Is-Admin-Project: True Sep 30 19:40:46.298135 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Openstack-Nova-Api-Version: 2.20 Sep 30 19:40:46.298135 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Domain-Id: default Sep 30 19:40:46.298135 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Domain-Name: Default Sep 30 19:40:46.298135 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Id: 395bb9b09f7948bbad5817c88aa4accc Sep 30 19:40:46.298135 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1709301466 Sep 30 19:40:46.298135 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Role: member,reader Sep 30 19:40:46.298135 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Roles: member,reader Sep 30 19:40:46.299705 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/395bb9b09f7948bbad5817c88aa4accc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/395bb9b09f7948bbad5817c88aa4accc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/395bb9b09f7948bbad5817c88aa4accc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_395bb9b09f7948bbad5817c88aa4accc"}]}] Sep 30 19:40:46.299705 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1709301466 Sep 30 19:40:46.299705 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant-Id: 395bb9b09f7948bbad5817c88aa4accc Sep 30 19:40:46.299705 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1709301466 Sep 30 19:40:46.299705 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User: tempest-AttachVolumeShelveTestJSON-1709301466-project Sep 30 19:40:46.299705 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Domain-Id: default Sep 30 19:40:46.299705 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Domain-Name: Default Sep 30 19:40:46.299705 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Id: f7aa40f3966d4c97ab6a1a764722969d Sep 30 19:40:46.299705 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1709301466-project Sep 30 19:40:46.299705 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: method: > Sep 30 19:40:46.299705 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: exception: Instance 67a09687-3d87-4069-b17c-6ed9b6e96700 could not be found. Sep 30 19:40:46.299705 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: action_args: {'id': '67a09687-3d87-4069-b17c-6ed9b6e96700'} Sep 30 19:40:46.300590 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:40:46.300590 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:40:46.300590 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 30 19:40:46.300590 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 30 19:40:46.300590 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 30 19:40:46.300590 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 30 19:40:46.300590 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 30 19:40:46.300590 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 30 19:40:46.300590 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 30 19:40:46.300590 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 30 19:40:46.300590 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67a09687-3d87-4069-b17c-6ed9b6e96700 could not be found. Sep 30 19:40:46.300590 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:40:46.300590 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:40:46.300590 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:40:46.300590 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:40:46.300590 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:40:46.300590 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:40:46.300590 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:40:46.300590 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:40:46.300590 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:40:46.302101 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:40:46.302101 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 30 19:40:46.302101 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 30 19:40:46.302101 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 30 19:40:46.302101 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 30 19:40:46.302101 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 30 19:40:46.302101 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 30 19:40:46.302101 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67a09687-3d87-4069-b17c-6ed9b6e96700 could not be found. Sep 30 19:40:46.302101 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:40:46.302101 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:40:46.302101 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:40:46.302101 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:40:46.302101 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:40:46.302101 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:40:46.302101 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:40:46.302101 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:40:46.302101 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67a09687-3d87-4069-b17c-6ed9b6e96700 could not be found. Sep 30 19:40:46.302101 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:40:46.303796 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-db031fd6-c458-4a80-9fab-4e50dfec8fa0 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Returning 404 to user: Instance 67a09687-3d87-4069-b17c-6ed9b6e96700 could not be found. {{(pid=120649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:40:46.303796 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-db031fd6-c458-4a80-9fab-4e50dfec8fa0 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 404 len: 111 microversion: 2.20 time: 0.036840 Sep 30 19:40:46.303796 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 553/1065] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:40:46 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 30 19:40:46.309190 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-48ff7b6c-faf5-420d-addf-ba0b9be0de00 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '.version_select at 0x7f621eda7d30>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:40:46.328488 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-48ff7b6c-faf5-420d-addf-ba0b9be0de00 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-457513319" status: 204 len: 0 microversion: 2.20 time: 0.023299 Sep 30 19:40:46.330367 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 513/1066] 10.222.0.17 () {60 vars in 1259 bytes} [Fri Sep 30 19:40:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-457513319 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 30 19:40:51.611486 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-abe73ecd-7c97-49e7-ad51-504c9a38ab6e tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2027562443", "imageRef": "7714d055-7d2c-4f56-9b14-45324361e286", "flavorRef": "452", "networks": [{"uuid": "3e9664b3-c8eb-4f77-bcba-0e5b00bd0f20"}]}} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:40:51.666156 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.network.neutron [None req-abe73ecd-7c97-49e7-ad51-504c9a38ab6e tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] validate_networks() for [('3e9664b3-c8eb-4f77-bcba-0e5b00bd0f20', None, None, None, None, None)] {{(pid=120649) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 30 19:40:52.068639 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.virt.hardware [None req-abe73ecd-7c97-49e7-ad51-504c9a38ab6e tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Flavor limits 0:0:0 {{(pid=120649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 30 19:40:52.069060 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.virt.hardware [None req-abe73ecd-7c97-49e7-ad51-504c9a38ab6e tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Image limits 0:0:0 {{(pid=120649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 30 19:40:52.069531 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.virt.hardware [None req-abe73ecd-7c97-49e7-ad51-504c9a38ab6e tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Flavor pref 0:0:0 {{(pid=120649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 30 19:40:52.069934 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.virt.hardware [None req-abe73ecd-7c97-49e7-ad51-504c9a38ab6e tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Image pref 0:0:0 {{(pid=120649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 30 19:40:52.070339 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.virt.hardware [None req-abe73ecd-7c97-49e7-ad51-504c9a38ab6e tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 30 19:40:52.079707 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-abe73ecd-7c97-49e7-ad51-504c9a38ab6e tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:52.080183 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-abe73ecd-7c97-49e7-ad51-504c9a38ab6e tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:52.080660 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-abe73ecd-7c97-49e7-ad51-504c9a38ab6e tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:52.081380 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-abe73ecd-7c97-49e7-ad51-504c9a38ab6e tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:52.081829 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-abe73ecd-7c97-49e7-ad51-504c9a38ab6e tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:52.082246 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-abe73ecd-7c97-49e7-ad51-504c9a38ab6e tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:52.098768 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.quota [None req-abe73ecd-7c97-49e7-ad51-504c9a38ab6e tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Getting quotas for project 9fb45af355274456bc3759ebb76f6b72. Resources: {'instances', 'ram', 'cores'} {{(pid=120649) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 30 19:40:52.102695 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.quota [None req-abe73ecd-7c97-49e7-ad51-504c9a38ab6e tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Getting quotas for user c5b46acc6b57473fa4cab2e37b761748 and project 9fb45af355274456bc3759ebb76f6b72. Resources: {'instances', 'ram', 'cores'} {{(pid=120649) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 30 19:40:52.113351 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-abe73ecd-7c97-49e7-ad51-504c9a38ab6e tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Going to run 1 instances... {{(pid=120649) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 30 19:40:52.115577 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-abe73ecd-7c97-49e7-ad51-504c9a38ab6e tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] [instance: 8cf27336-b00a-4fc7-ab9e-e5c8116d41e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7714d055-7d2c-4f56-9b14-45324361e286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 30 19:40:52.161170 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-abe73ecd-7c97-49e7-ad51-504c9a38ab6e tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.553128 Sep 30 19:40:52.162000 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 554/1067] 10.222.0.17 () {60 vars in 1147 bytes} [Fri Sep 30 19:40:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 30 19:40:52.174095 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-65af3f44-bf0f-4341-85d3-deb9533b5596 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:40:52.174859 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-65af3f44-bf0f-4341-85d3-deb9533b5596 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] [instance: 8cf27336-b00a-4fc7-ab9e-e5c8116d41e4] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:40:52.236023 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-65af3f44-bf0f-4341-85d3-deb9533b5596 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b46acc6b57473fa4cab2e37b761748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb45af355274456bc3759ebb76f6b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:40:52.243796 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-65af3f44-bf0f-4341-85d3-deb9533b5596 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] 10.222.0.17 "GET /compute/v2.1/servers/8cf27336-b00a-4fc7-ab9e-e5c8116d41e4" status: 200 len: 1219 microversion: 2.1 time: 0.074234 Sep 30 19:40:52.245063 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 514/1068] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:40:52 2022] GET /compute/v2.1/servers/8cf27336-b00a-4fc7-ab9e-e5c8116d41e4 => generated 1219 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:40:52.496293 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-7fc7c7a0-1e69-4771-bd17-70d976e810ab tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:40:52.497034 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-7fc7c7a0-1e69-4771-bd17-70d976e810ab tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:40:52.503700 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7fc7c7a0-1e69-4771-bd17-70d976e810ab tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:52.504178 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7fc7c7a0-1e69-4771-bd17-70d976e810ab tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:52.504642 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7fc7c7a0-1e69-4771-bd17-70d976e810ab tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:52.505328 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7fc7c7a0-1e69-4771-bd17-70d976e810ab tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:52.505918 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7fc7c7a0-1e69-4771-bd17-70d976e810ab tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:52.506346 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7fc7c7a0-1e69-4771-bd17-70d976e810ab tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:52.519807 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.wsgi [None req-7fc7c7a0-1e69-4771-bd17-70d976e810ab tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] HTTP exception thrown: Instance 67a09687-3d87-4069-b17c-6ed9b6e96700 could not be found. Sep 30 19:40:52.521397 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-7fc7c7a0-1e69-4771-bd17-70d976e810ab tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Request method failure captured: Sep 30 19:40:52.521397 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: request: DELETE /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 HTTP/1.1 Sep 30 19:40:52.521397 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Accept: application/json Sep 30 19:40:52.521397 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Accept-Encoding: identity Sep 30 19:40:52.521397 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Connection: close Sep 30 19:40:52.521397 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Content-Length: 0 Sep 30 19:40:52.521397 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Content-Type: application/json Sep 30 19:40:52.521397 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Host: 10.222.0.17 Sep 30 19:40:52.521397 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Openstack-System-Scope: None Sep 30 19:40:52.521397 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: User-Agent: python-urllib3/1.26.12 Sep 30 19:40:52.521397 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Auth-Token: gAAAAABjN0ONOwIbxc91xU7l52C5Fy5ArsRt6ZX45qakD2SHqVzbm57ZiOsFY9DJEc7VM20VbNzf_nMkRzugCjpggS9pLU0vkBtv9Nb8dhUHNADVjRcXlSEqEvNvAzNcvlBQ5lqdZ11HA75fhmXNMWOsHwjHRW6QioUNPVnYNgMj-6Kfcx2lCKY Sep 30 19:40:52.521397 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Domain-Id: None Sep 30 19:40:52.521397 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Domain-Name: None Sep 30 19:40:52.521397 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Identity-Status: Confirmed Sep 30 19:40:52.521397 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Is-Admin-Project: True Sep 30 19:40:52.521397 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Openstack-Nova-Api-Version: 2.20 Sep 30 19:40:52.521397 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Domain-Id: default Sep 30 19:40:52.521397 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Domain-Name: Default Sep 30 19:40:52.521397 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Id: 395bb9b09f7948bbad5817c88aa4accc Sep 30 19:40:52.521397 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1709301466 Sep 30 19:40:52.521397 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Role: member,reader Sep 30 19:40:52.521397 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Roles: member,reader Sep 30 19:40:52.523108 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/395bb9b09f7948bbad5817c88aa4accc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/395bb9b09f7948bbad5817c88aa4accc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/395bb9b09f7948bbad5817c88aa4accc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_395bb9b09f7948bbad5817c88aa4accc"}]}] Sep 30 19:40:52.523108 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1709301466 Sep 30 19:40:52.523108 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant-Id: 395bb9b09f7948bbad5817c88aa4accc Sep 30 19:40:52.523108 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1709301466 Sep 30 19:40:52.523108 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User: tempest-AttachVolumeShelveTestJSON-1709301466-project Sep 30 19:40:52.523108 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Domain-Id: default Sep 30 19:40:52.523108 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Domain-Name: Default Sep 30 19:40:52.523108 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Id: f7aa40f3966d4c97ab6a1a764722969d Sep 30 19:40:52.523108 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1709301466-project Sep 30 19:40:52.523108 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: method: > Sep 30 19:40:52.523108 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: exception: Instance 67a09687-3d87-4069-b17c-6ed9b6e96700 could not be found. Sep 30 19:40:52.523108 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: action_args: {'id': '67a09687-3d87-4069-b17c-6ed9b6e96700'} Sep 30 19:40:52.527033 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:40:52.527033 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:40:52.527033 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 30 19:40:52.527033 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 30 19:40:52.527033 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 30 19:40:52.527033 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 30 19:40:52.527033 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 30 19:40:52.527033 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 30 19:40:52.527033 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 30 19:40:52.527033 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 30 19:40:52.527033 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67a09687-3d87-4069-b17c-6ed9b6e96700 could not be found. Sep 30 19:40:52.527033 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:40:52.527033 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:40:52.527033 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:40:52.527033 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:40:52.527033 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:40:52.527033 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:40:52.527033 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:40:52.527033 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:40:52.527033 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:40:52.528803 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:40:52.528803 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 30 19:40:52.528803 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 30 19:40:52.528803 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 30 19:40:52.528803 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 30 19:40:52.528803 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 30 19:40:52.528803 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 30 19:40:52.528803 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 30 19:40:52.528803 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 30 19:40:52.528803 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67a09687-3d87-4069-b17c-6ed9b6e96700 could not be found. Sep 30 19:40:52.528803 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:40:52.528803 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:40:52.528803 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:40:52.528803 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:40:52.528803 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:40:52.528803 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:40:52.528803 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:40:52.528803 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:40:52.528803 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67a09687-3d87-4069-b17c-6ed9b6e96700 could not be found. Sep 30 19:40:52.528803 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:40:52.530301 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-7fc7c7a0-1e69-4771-bd17-70d976e810ab tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Returning 404 to user: Instance 67a09687-3d87-4069-b17c-6ed9b6e96700 could not be found. {{(pid=120649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:40:52.530301 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-7fc7c7a0-1e69-4771-bd17-70d976e810ab tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "DELETE /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 404 len: 111 microversion: 2.20 time: 0.030516 Sep 30 19:40:52.530301 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 555/1069] 10.222.0.17 () {60 vars in 1280 bytes} [Fri Sep 30 19:40:52 2022] DELETE /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 30 19:40:52.531917 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-6f12a1f2-6d5a-44f6-8ed9-168151740f3b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:40:52.533474 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-6f12a1f2-6d5a-44f6-8ed9-168151740f3b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: 67a09687-3d87-4069-b17c-6ed9b6e96700] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:40:52.539899 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6f12a1f2-6d5a-44f6-8ed9-168151740f3b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:52.540466 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6f12a1f2-6d5a-44f6-8ed9-168151740f3b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:52.540952 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6f12a1f2-6d5a-44f6-8ed9-168151740f3b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:52.541733 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6f12a1f2-6d5a-44f6-8ed9-168151740f3b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:52.542378 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6f12a1f2-6d5a-44f6-8ed9-168151740f3b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:52.542822 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6f12a1f2-6d5a-44f6-8ed9-168151740f3b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:52.556032 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.wsgi [None req-6f12a1f2-6d5a-44f6-8ed9-168151740f3b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] HTTP exception thrown: Instance 67a09687-3d87-4069-b17c-6ed9b6e96700 could not be found. Sep 30 19:40:52.557700 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-6f12a1f2-6d5a-44f6-8ed9-168151740f3b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Request method failure captured: Sep 30 19:40:52.557700 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: request: GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 HTTP/1.1 Sep 30 19:40:52.557700 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 30 19:40:52.557700 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 30 19:40:52.557700 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Connection: close Sep 30 19:40:52.557700 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Length: 0 Sep 30 19:40:52.557700 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 30 19:40:52.557700 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Host: 10.222.0.17 Sep 30 19:40:52.557700 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 30 19:40:52.557700 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 30 19:40:52.557700 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjN0ONOwIbxc91xU7l52C5Fy5ArsRt6ZX45qakD2SHqVzbm57ZiOsFY9DJEc7VM20VbNzf_nMkRzugCjpggS9pLU0vkBtv9Nb8dhUHNADVjRcXlSEqEvNvAzNcvlBQ5lqdZ11HA75fhmXNMWOsHwjHRW6QioUNPVnYNgMj-6Kfcx2lCKY Sep 30 19:40:52.557700 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 30 19:40:52.557700 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 30 19:40:52.557700 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 30 19:40:52.557700 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 30 19:40:52.557700 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Openstack-Nova-Api-Version: 2.20 Sep 30 19:40:52.557700 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 30 19:40:52.557700 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 30 19:40:52.557700 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Id: 395bb9b09f7948bbad5817c88aa4accc Sep 30 19:40:52.557700 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1709301466 Sep 30 19:40:52.557700 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 30 19:40:52.557700 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 30 19:40:52.559391 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/395bb9b09f7948bbad5817c88aa4accc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/395bb9b09f7948bbad5817c88aa4accc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/395bb9b09f7948bbad5817c88aa4accc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_395bb9b09f7948bbad5817c88aa4accc"}]}] Sep 30 19:40:52.559391 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1709301466 Sep 30 19:40:52.559391 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Id: 395bb9b09f7948bbad5817c88aa4accc Sep 30 19:40:52.559391 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1709301466 Sep 30 19:40:52.559391 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User: tempest-AttachVolumeShelveTestJSON-1709301466-project Sep 30 19:40:52.559391 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 30 19:40:52.559391 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 30 19:40:52.559391 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Id: f7aa40f3966d4c97ab6a1a764722969d Sep 30 19:40:52.559391 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1709301466-project Sep 30 19:40:52.559391 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: method: > Sep 30 19:40:52.559391 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: exception: Instance 67a09687-3d87-4069-b17c-6ed9b6e96700 could not be found. Sep 30 19:40:52.559391 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: action_args: {'id': '67a09687-3d87-4069-b17c-6ed9b6e96700'} Sep 30 19:40:52.560237 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:40:52.560237 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:40:52.560237 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 30 19:40:52.560237 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 30 19:40:52.560237 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 30 19:40:52.560237 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 30 19:40:52.560237 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 30 19:40:52.560237 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 30 19:40:52.560237 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 30 19:40:52.560237 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 30 19:40:52.560237 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67a09687-3d87-4069-b17c-6ed9b6e96700 could not be found. Sep 30 19:40:52.560237 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:40:52.560237 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:40:52.560237 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:40:52.560237 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:40:52.560237 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:40:52.560237 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:40:52.560237 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:40:52.560237 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:40:52.560237 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:40:52.561738 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:40:52.561738 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 30 19:40:52.561738 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 30 19:40:52.561738 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 30 19:40:52.561738 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 30 19:40:52.561738 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 30 19:40:52.561738 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 30 19:40:52.561738 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67a09687-3d87-4069-b17c-6ed9b6e96700 could not be found. Sep 30 19:40:52.561738 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:40:52.561738 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:40:52.561738 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:40:52.561738 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:40:52.561738 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:40:52.561738 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:40:52.561738 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:40:52.561738 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:40:52.561738 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67a09687-3d87-4069-b17c-6ed9b6e96700 could not be found. Sep 30 19:40:52.561738 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:40:52.563009 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-6f12a1f2-6d5a-44f6-8ed9-168151740f3b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Returning 404 to user: Instance 67a09687-3d87-4069-b17c-6ed9b6e96700 could not be found. {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:40:52.563009 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-6f12a1f2-6d5a-44f6-8ed9-168151740f3b tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700" status: 404 len: 111 microversion: 2.20 time: 0.031497 Sep 30 19:40:52.563009 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 515/1070] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:40:52 2022] GET /compute/v2.1/servers/67a09687-3d87-4069-b17c-6ed9b6e96700 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 30 19:40:53.271793 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-052c2692-04d8-4f88-b9cb-49d5a6f836c2 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:40:53.272551 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-052c2692-04d8-4f88-b9cb-49d5a6f836c2 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] [instance: 8cf27336-b00a-4fc7-ab9e-e5c8116d41e4] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:40:53.279581 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-052c2692-04d8-4f88-b9cb-49d5a6f836c2 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:53.280072 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-052c2692-04d8-4f88-b9cb-49d5a6f836c2 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:53.280541 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-052c2692-04d8-4f88-b9cb-49d5a6f836c2 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:53.281253 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-052c2692-04d8-4f88-b9cb-49d5a6f836c2 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:53.281710 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-052c2692-04d8-4f88-b9cb-49d5a6f836c2 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:53.282139 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-052c2692-04d8-4f88-b9cb-49d5a6f836c2 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:53.375543 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-052c2692-04d8-4f88-b9cb-49d5a6f836c2 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b46acc6b57473fa4cab2e37b761748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb45af355274456bc3759ebb76f6b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:40:53.385388 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-052c2692-04d8-4f88-b9cb-49d5a6f836c2 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] 10.222.0.17 "GET /compute/v2.1/servers/8cf27336-b00a-4fc7-ab9e-e5c8116d41e4" status: 200 len: 1279 microversion: 2.1 time: 0.117971 Sep 30 19:40:53.385969 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 556/1071] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:40:53 2022] GET /compute/v2.1/servers/8cf27336-b00a-4fc7-ab9e-e5c8116d41e4 => generated 1279 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:40:53.705083 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e7b92441-8f00-4eb4-867d-25c50247c514 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:40:53.705638 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-e7b92441-8f00-4eb4-867d-25c50247c514 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:40:53.711992 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e7b92441-8f00-4eb4-867d-25c50247c514 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:53.712522 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e7b92441-8f00-4eb4-867d-25c50247c514 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:53.712970 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e7b92441-8f00-4eb4-867d-25c50247c514 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:53.713663 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e7b92441-8f00-4eb4-867d-25c50247c514 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:53.714139 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e7b92441-8f00-4eb4-867d-25c50247c514 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:53.714559 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e7b92441-8f00-4eb4-867d-25c50247c514 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:53.728532 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.wsgi [None req-e7b92441-8f00-4eb4-867d-25c50247c514 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] HTTP exception thrown: Instance c87cf7d2-5d47-474b-b2f0-1ddc37bc97df could not be found. Sep 30 19:40:53.730302 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e7b92441-8f00-4eb4-867d-25c50247c514 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Request method failure captured: Sep 30 19:40:53.730302 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: request: DELETE /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df HTTP/1.1 Sep 30 19:40:53.730302 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 30 19:40:53.730302 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 30 19:40:53.730302 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Connection: close Sep 30 19:40:53.730302 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Length: 0 Sep 30 19:40:53.730302 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 30 19:40:53.730302 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Host: 10.222.0.17 Sep 30 19:40:53.730302 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 30 19:40:53.730302 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 30 19:40:53.730302 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjN0ONOwIbxc91xU7l52C5Fy5ArsRt6ZX45qakD2SHqVzbm57ZiOsFY9DJEc7VM20VbNzf_nMkRzugCjpggS9pLU0vkBtv9Nb8dhUHNADVjRcXlSEqEvNvAzNcvlBQ5lqdZ11HA75fhmXNMWOsHwjHRW6QioUNPVnYNgMj-6Kfcx2lCKY Sep 30 19:40:53.730302 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 30 19:40:53.730302 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 30 19:40:53.730302 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 30 19:40:53.730302 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 30 19:40:53.730302 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Openstack-Nova-Api-Version: 2.20 Sep 30 19:40:53.730302 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 30 19:40:53.730302 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 30 19:40:53.730302 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Id: 395bb9b09f7948bbad5817c88aa4accc Sep 30 19:40:53.730302 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1709301466 Sep 30 19:40:53.730302 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 30 19:40:53.730302 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 30 19:40:53.732102 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/395bb9b09f7948bbad5817c88aa4accc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/395bb9b09f7948bbad5817c88aa4accc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/395bb9b09f7948bbad5817c88aa4accc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_395bb9b09f7948bbad5817c88aa4accc"}]}] Sep 30 19:40:53.732102 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1709301466 Sep 30 19:40:53.732102 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Id: 395bb9b09f7948bbad5817c88aa4accc Sep 30 19:40:53.732102 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1709301466 Sep 30 19:40:53.732102 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User: tempest-AttachVolumeShelveTestJSON-1709301466-project Sep 30 19:40:53.732102 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 30 19:40:53.732102 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 30 19:40:53.732102 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Id: f7aa40f3966d4c97ab6a1a764722969d Sep 30 19:40:53.732102 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1709301466-project Sep 30 19:40:53.732102 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: method: > Sep 30 19:40:53.732102 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: exception: Instance c87cf7d2-5d47-474b-b2f0-1ddc37bc97df could not be found. Sep 30 19:40:53.732102 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: action_args: {'id': 'c87cf7d2-5d47-474b-b2f0-1ddc37bc97df'} Sep 30 19:40:53.733191 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:40:53.733191 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:40:53.733191 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 30 19:40:53.733191 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 30 19:40:53.733191 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 30 19:40:53.733191 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 30 19:40:53.733191 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 30 19:40:53.733191 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 30 19:40:53.733191 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 30 19:40:53.733191 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 30 19:40:53.733191 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c87cf7d2-5d47-474b-b2f0-1ddc37bc97df could not be found. Sep 30 19:40:53.733191 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:40:53.733191 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:40:53.733191 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:40:53.733191 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:40:53.733191 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:40:53.733191 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:40:53.733191 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:40:53.733191 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:40:53.733191 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:40:53.734499 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:40:53.734499 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 30 19:40:53.734499 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 30 19:40:53.734499 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 30 19:40:53.734499 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 30 19:40:53.734499 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 30 19:40:53.734499 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 30 19:40:53.734499 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 30 19:40:53.734499 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 30 19:40:53.734499 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c87cf7d2-5d47-474b-b2f0-1ddc37bc97df could not be found. Sep 30 19:40:53.734499 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:40:53.734499 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:40:53.734499 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:40:53.734499 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:40:53.734499 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:40:53.734499 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:40:53.734499 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:40:53.734499 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:40:53.734499 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c87cf7d2-5d47-474b-b2f0-1ddc37bc97df could not be found. Sep 30 19:40:53.734499 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:40:53.736322 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e7b92441-8f00-4eb4-867d-25c50247c514 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Returning 404 to user: Instance c87cf7d2-5d47-474b-b2f0-1ddc37bc97df could not be found. {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:40:53.736322 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-e7b92441-8f00-4eb4-867d-25c50247c514 tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 404 len: 111 microversion: 2.20 time: 0.031296 Sep 30 19:40:53.736322 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 516/1072] 10.222.0.17 () {60 vars in 1280 bytes} [Fri Sep 30 19:40:53 2022] DELETE /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 30 19:40:53.740334 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-27bb183b-8a83-4217-9934-b20ef939ed2d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:40:53.740970 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-27bb183b-8a83-4217-9934-b20ef939ed2d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] [instance: c87cf7d2-5d47-474b-b2f0-1ddc37bc97df] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:40:53.746920 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-27bb183b-8a83-4217-9934-b20ef939ed2d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:53.747409 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-27bb183b-8a83-4217-9934-b20ef939ed2d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:53.747853 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-27bb183b-8a83-4217-9934-b20ef939ed2d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:53.748697 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-27bb183b-8a83-4217-9934-b20ef939ed2d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:53.749157 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-27bb183b-8a83-4217-9934-b20ef939ed2d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:53.749585 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-27bb183b-8a83-4217-9934-b20ef939ed2d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:53.762786 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.wsgi [None req-27bb183b-8a83-4217-9934-b20ef939ed2d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] HTTP exception thrown: Instance c87cf7d2-5d47-474b-b2f0-1ddc37bc97df could not be found. Sep 30 19:40:53.764331 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-27bb183b-8a83-4217-9934-b20ef939ed2d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Request method failure captured: Sep 30 19:40:53.764331 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: request: GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df HTTP/1.1 Sep 30 19:40:53.764331 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Accept: application/json Sep 30 19:40:53.764331 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Accept-Encoding: identity Sep 30 19:40:53.764331 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Connection: close Sep 30 19:40:53.764331 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Content-Length: 0 Sep 30 19:40:53.764331 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Content-Type: application/json Sep 30 19:40:53.764331 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Host: 10.222.0.17 Sep 30 19:40:53.764331 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Openstack-System-Scope: None Sep 30 19:40:53.764331 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: User-Agent: python-urllib3/1.26.12 Sep 30 19:40:53.764331 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Auth-Token: gAAAAABjN0ONOwIbxc91xU7l52C5Fy5ArsRt6ZX45qakD2SHqVzbm57ZiOsFY9DJEc7VM20VbNzf_nMkRzugCjpggS9pLU0vkBtv9Nb8dhUHNADVjRcXlSEqEvNvAzNcvlBQ5lqdZ11HA75fhmXNMWOsHwjHRW6QioUNPVnYNgMj-6Kfcx2lCKY Sep 30 19:40:53.764331 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Domain-Id: None Sep 30 19:40:53.764331 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Domain-Name: None Sep 30 19:40:53.764331 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Identity-Status: Confirmed Sep 30 19:40:53.764331 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Is-Admin-Project: True Sep 30 19:40:53.764331 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Openstack-Nova-Api-Version: 2.20 Sep 30 19:40:53.764331 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Domain-Id: default Sep 30 19:40:53.764331 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Domain-Name: Default Sep 30 19:40:53.764331 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Id: 395bb9b09f7948bbad5817c88aa4accc Sep 30 19:40:53.764331 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1709301466 Sep 30 19:40:53.764331 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Role: member,reader Sep 30 19:40:53.764331 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Roles: member,reader Sep 30 19:40:53.765897 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/395bb9b09f7948bbad5817c88aa4accc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/395bb9b09f7948bbad5817c88aa4accc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/395bb9b09f7948bbad5817c88aa4accc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_395bb9b09f7948bbad5817c88aa4accc"}]}] Sep 30 19:40:53.765897 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1709301466 Sep 30 19:40:53.765897 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant-Id: 395bb9b09f7948bbad5817c88aa4accc Sep 30 19:40:53.765897 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1709301466 Sep 30 19:40:53.765897 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User: tempest-AttachVolumeShelveTestJSON-1709301466-project Sep 30 19:40:53.765897 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Domain-Id: default Sep 30 19:40:53.765897 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Domain-Name: Default Sep 30 19:40:53.765897 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Id: f7aa40f3966d4c97ab6a1a764722969d Sep 30 19:40:53.765897 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1709301466-project Sep 30 19:40:53.765897 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: method: > Sep 30 19:40:53.765897 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: exception: Instance c87cf7d2-5d47-474b-b2f0-1ddc37bc97df could not be found. Sep 30 19:40:53.765897 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: action_args: {'id': 'c87cf7d2-5d47-474b-b2f0-1ddc37bc97df'} Sep 30 19:40:53.767193 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:40:53.767193 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:40:53.767193 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 30 19:40:53.767193 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 30 19:40:53.767193 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 30 19:40:53.767193 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 30 19:40:53.767193 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 30 19:40:53.767193 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 30 19:40:53.767193 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 30 19:40:53.767193 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 30 19:40:53.767193 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c87cf7d2-5d47-474b-b2f0-1ddc37bc97df could not be found. Sep 30 19:40:53.767193 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:40:53.767193 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:40:53.767193 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:40:53.767193 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:40:53.767193 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:40:53.767193 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:40:53.767193 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:40:53.767193 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:40:53.767193 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:40:53.769301 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:40:53.769301 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 30 19:40:53.769301 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 30 19:40:53.769301 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 30 19:40:53.769301 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 30 19:40:53.769301 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 30 19:40:53.769301 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 30 19:40:53.769301 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c87cf7d2-5d47-474b-b2f0-1ddc37bc97df could not be found. Sep 30 19:40:53.769301 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:40:53.769301 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:40:53.769301 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:40:53.769301 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:40:53.769301 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:40:53.769301 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:40:53.769301 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:40:53.769301 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:40:53.769301 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c87cf7d2-5d47-474b-b2f0-1ddc37bc97df could not be found. Sep 30 19:40:53.769301 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:40:53.770985 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-27bb183b-8a83-4217-9934-b20ef939ed2d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] Returning 404 to user: Instance c87cf7d2-5d47-474b-b2f0-1ddc37bc97df could not be found. {{(pid=120649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:40:53.770985 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-27bb183b-8a83-4217-9934-b20ef939ed2d tempest-AttachVolumeShelveTestJSON-1709301466 tempest-AttachVolumeShelveTestJSON-1709301466-project] 10.222.0.17 "GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df" status: 404 len: 111 microversion: 2.20 time: 0.029349 Sep 30 19:40:53.770985 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 557/1073] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 30 19:40:53 2022] GET /compute/v2.1/servers/c87cf7d2-5d47-474b-b2f0-1ddc37bc97df => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 30 19:40:54.409540 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-3367b458-c220-4e15-8261-1d433d895b4e tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:40:54.411208 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-3367b458-c220-4e15-8261-1d433d895b4e tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] [instance: 8cf27336-b00a-4fc7-ab9e-e5c8116d41e4] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:40:54.419404 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3367b458-c220-4e15-8261-1d433d895b4e tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:54.420239 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3367b458-c220-4e15-8261-1d433d895b4e tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:54.421085 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3367b458-c220-4e15-8261-1d433d895b4e tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:54.422031 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3367b458-c220-4e15-8261-1d433d895b4e tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:54.422622 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3367b458-c220-4e15-8261-1d433d895b4e tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:54.424031 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3367b458-c220-4e15-8261-1d433d895b4e tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:54.639311 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-3367b458-c220-4e15-8261-1d433d895b4e tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b46acc6b57473fa4cab2e37b761748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb45af355274456bc3759ebb76f6b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:40:54.647573 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-3367b458-c220-4e15-8261-1d433d895b4e tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] 10.222.0.17 "GET /compute/v2.1/servers/8cf27336-b00a-4fc7-ab9e-e5c8116d41e4" status: 200 len: 1319 microversion: 2.1 time: 0.242772 Sep 30 19:40:54.648136 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 517/1074] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:40:54 2022] GET /compute/v2.1/servers/8cf27336-b00a-4fc7-ab9e-e5c8116d41e4 => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:40:54.978032 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [req-058403fc-dc5d-4325-8712-12a8e8a186c9 req-d3f658ca-4b30-4eda-8185-c65cd311e5fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cf27336-b00a-4fc7-ab9e-e5c8116d41e4", "tag": "e8570c00-a37a-4350-8728-48685d65618a"}]} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:40:54.990728 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=6 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:40:54.994113 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-058403fc-dc5d-4325-8712-12a8e8a186c9 req-d3f658ca-4b30-4eda-8185-c65cd311e5fb service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:54.995029 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-058403fc-dc5d-4325-8712-12a8e8a186c9 req-d3f658ca-4b30-4eda-8185-c65cd311e5fb service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:54.996357 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-058403fc-dc5d-4325-8712-12a8e8a186c9 req-d3f658ca-4b30-4eda-8185-c65cd311e5fb service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:55.005877 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell1:SELECT=79 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:40:55.022449 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.compute.server_external_events [req-058403fc-dc5d-4325-8712-12a8e8a186c9 req-d3f658ca-4b30-4eda-8185-c65cd311e5fb service nova] Creating event network-changed:e8570c00-a37a-4350-8728-48685d65618a for instance 8cf27336-b00a-4fc7-ab9e-e5c8116d41e4 on hv-cinder-86001 Sep 30 19:40:55.036294 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [req-058403fc-dc5d-4325-8712-12a8e8a186c9 req-d3f658ca-4b30-4eda-8185-c65cd311e5fb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062468 Sep 30 19:40:55.037273 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 558/1075] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 30 19:40:55.670887 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-73afdf28-10b6-4c32-a4c2-e59a2c52e112 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:40:55.671657 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-73afdf28-10b6-4c32-a4c2-e59a2c52e112 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] [instance: 8cf27336-b00a-4fc7-ab9e-e5c8116d41e4] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:40:55.677373 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:40:55.679240 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-73afdf28-10b6-4c32-a4c2-e59a2c52e112 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:55.679748 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-73afdf28-10b6-4c32-a4c2-e59a2c52e112 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:55.680388 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-73afdf28-10b6-4c32-a4c2-e59a2c52e112 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:55.681088 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-73afdf28-10b6-4c32-a4c2-e59a2c52e112 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:55.681542 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-73afdf28-10b6-4c32-a4c2-e59a2c52e112 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:55.681960 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-73afdf28-10b6-4c32-a4c2-e59a2c52e112 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:55.685190 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:40:55.899941 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-73afdf28-10b6-4c32-a4c2-e59a2c52e112 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b46acc6b57473fa4cab2e37b761748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb45af355274456bc3759ebb76f6b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:40:55.909657 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-73afdf28-10b6-4c32-a4c2-e59a2c52e112 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] 10.222.0.17 "GET /compute/v2.1/servers/8cf27336-b00a-4fc7-ab9e-e5c8116d41e4" status: 200 len: 1319 microversion: 2.1 time: 0.242582 Sep 30 19:40:55.924595 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 518/1076] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:40:55 2022] GET /compute/v2.1/servers/8cf27336-b00a-4fc7-ab9e-e5c8116d41e4 => generated 1319 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:40:56.934912 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-fbc940f0-2382-4948-9b13-cffb23fbc773 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:40:56.936130 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-fbc940f0-2382-4948-9b13-cffb23fbc773 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] [instance: 8cf27336-b00a-4fc7-ab9e-e5c8116d41e4] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:40:56.947716 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-fbc940f0-2382-4948-9b13-cffb23fbc773 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:56.948235 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-fbc940f0-2382-4948-9b13-cffb23fbc773 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:56.949178 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-fbc940f0-2382-4948-9b13-cffb23fbc773 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:56.950523 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-fbc940f0-2382-4948-9b13-cffb23fbc773 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:56.950988 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-fbc940f0-2382-4948-9b13-cffb23fbc773 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:56.951623 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-fbc940f0-2382-4948-9b13-cffb23fbc773 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:57.136073 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-fbc940f0-2382-4948-9b13-cffb23fbc773 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b46acc6b57473fa4cab2e37b761748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb45af355274456bc3759ebb76f6b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:40:57.145675 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-fbc940f0-2382-4948-9b13-cffb23fbc773 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] 10.222.0.17 "GET /compute/v2.1/servers/8cf27336-b00a-4fc7-ab9e-e5c8116d41e4" status: 200 len: 1319 microversion: 2.1 time: 0.215985 Sep 30 19:40:57.146459 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 559/1077] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:40:56 2022] GET /compute/v2.1/servers/8cf27336-b00a-4fc7-ab9e-e5c8116d41e4 => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:40:58.172438 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-f1969845-ae9c-48e7-be01-1c699415fc72 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:40:58.173593 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-f1969845-ae9c-48e7-be01-1c699415fc72 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] [instance: 8cf27336-b00a-4fc7-ab9e-e5c8116d41e4] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:40:58.180516 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f1969845-ae9c-48e7-be01-1c699415fc72 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:58.181185 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f1969845-ae9c-48e7-be01-1c699415fc72 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:58.181976 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f1969845-ae9c-48e7-be01-1c699415fc72 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:58.182712 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f1969845-ae9c-48e7-be01-1c699415fc72 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:58.183171 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f1969845-ae9c-48e7-be01-1c699415fc72 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:58.183595 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f1969845-ae9c-48e7-be01-1c699415fc72 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:58.324212 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f1969845-ae9c-48e7-be01-1c699415fc72 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b46acc6b57473fa4cab2e37b761748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb45af355274456bc3759ebb76f6b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:40:58.332452 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-f1969845-ae9c-48e7-be01-1c699415fc72 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] 10.222.0.17 "GET /compute/v2.1/servers/8cf27336-b00a-4fc7-ab9e-e5c8116d41e4" status: 200 len: 1319 microversion: 2.1 time: 0.163816 Sep 30 19:40:58.333023 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 519/1078] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:40:58 2022] GET /compute/v2.1/servers/8cf27336-b00a-4fc7-ab9e-e5c8116d41e4 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:40:58.479188 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-ed740d88-0ce8-4794-a540-46f2f31ff20c tempest-VolumesGetTestJSON-777457834 tempest-VolumesGetTestJSON-777457834-project] Action: 'create', calling method: .version_select at 0x7f62227e74c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1534057717", "metadata": {"Type": "work"}}} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:40:58.771203 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-ed740d88-0ce8-4794-a540-46f2f31ff20c tempest-VolumesGetTestJSON-777457834 tempest-VolumesGetTestJSON-777457834-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.413966 Sep 30 19:40:58.771829 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 560/1079] 10.222.0.17 () {60 vars in 1156 bytes} [Fri Sep 30 19:40:58 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 415 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 30 19:40:58.785105 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-83c34fd8-9fa8-4fe6-b92f-9a34cb54b9e3 tempest-VolumesGetTestJSON-777457834 tempest-VolumesGetTestJSON-777457834-project] Calling method '.version_select at 0x7f621ee12f70>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:40:58.834492 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-83c34fd8-9fa8-4fe6-b92f-9a34cb54b9e3 tempest-VolumesGetTestJSON-777457834 tempest-VolumesGetTestJSON-777457834-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/8c32126e-3465-40c7-8942-b00fad2b6a82" status: 200 len: 353 microversion: 2.1 time: 0.053607 Sep 30 19:40:58.835151 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 520/1080] 10.222.0.17 () {58 vars in 1245 bytes} [Fri Sep 30 19:40:58 2022] GET /compute/v2.1/os-volumes/8c32126e-3465-40c7-8942-b00fad2b6a82 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:40:59.355023 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-aa2ed808-98ff-4521-81b3-413d485a9fda tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:40:59.355650 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-aa2ed808-98ff-4521-81b3-413d485a9fda tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] [instance: 8cf27336-b00a-4fc7-ab9e-e5c8116d41e4] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:40:59.363401 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-aa2ed808-98ff-4521-81b3-413d485a9fda tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:59.363890 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-aa2ed808-98ff-4521-81b3-413d485a9fda tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:59.364335 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-aa2ed808-98ff-4521-81b3-413d485a9fda tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:59.365130 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-aa2ed808-98ff-4521-81b3-413d485a9fda tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:40:59.365591 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-aa2ed808-98ff-4521-81b3-413d485a9fda tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:40:59.366026 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-aa2ed808-98ff-4521-81b3-413d485a9fda tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:40:59.493250 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-aa2ed808-98ff-4521-81b3-413d485a9fda tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b46acc6b57473fa4cab2e37b761748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb45af355274456bc3759ebb76f6b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:40:59.500901 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-aa2ed808-98ff-4521-81b3-413d485a9fda tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] 10.222.0.17 "GET /compute/v2.1/servers/8cf27336-b00a-4fc7-ab9e-e5c8116d41e4" status: 200 len: 1319 microversion: 2.1 time: 0.149732 Sep 30 19:40:59.501464 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 561/1081] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:40:59 2022] GET /compute/v2.1/servers/8cf27336-b00a-4fc7-ab9e-e5c8116d41e4 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:40:59.850445 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-644e5639-5581-4a5f-a09c-ef2fc2fcb0eb tempest-VolumesGetTestJSON-777457834 tempest-VolumesGetTestJSON-777457834-project] Calling method '.version_select at 0x7f621efdc8b0>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:40:59.895611 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-644e5639-5581-4a5f-a09c-ef2fc2fcb0eb tempest-VolumesGetTestJSON-777457834 tempest-VolumesGetTestJSON-777457834-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/8c32126e-3465-40c7-8942-b00fad2b6a82" status: 200 len: 354 microversion: 2.1 time: 0.049405 Sep 30 19:40:59.896164 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 521/1082] 10.222.0.17 () {58 vars in 1245 bytes} [Fri Sep 30 19:40:59 2022] GET /compute/v2.1/os-volumes/8c32126e-3465-40c7-8942-b00fad2b6a82 => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:40:59.909429 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-c66ec945-3285-4b43-ae5b-2bd84a7d9242 tempest-VolumesGetTestJSON-777457834 tempest-VolumesGetTestJSON-777457834-project] Calling method '.version_select at 0x7f621f336ca0>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:40:59.955351 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-c66ec945-3285-4b43-ae5b-2bd84a7d9242 tempest-VolumesGetTestJSON-777457834 tempest-VolumesGetTestJSON-777457834-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/8c32126e-3465-40c7-8942-b00fad2b6a82" status: 200 len: 354 microversion: 2.1 time: 0.050260 Sep 30 19:40:59.955915 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 562/1083] 10.222.0.17 () {58 vars in 1245 bytes} [Fri Sep 30 19:40:59 2022] GET /compute/v2.1/os-volumes/8c32126e-3465-40c7-8942-b00fad2b6a82 => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:40:59.974778 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-3d9a326a-b5a3-4a35-923b-b47d48cb4b37 tempest-VolumesGetTestJSON-777457834 tempest-VolumesGetTestJSON-777457834-project] Calling method '.version_select at 0x7f621efdc550>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:41:00.033003 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-3d9a326a-b5a3-4a35-923b-b47d48cb4b37 tempest-VolumesGetTestJSON-777457834 tempest-VolumesGetTestJSON-777457834-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/8c32126e-3465-40c7-8942-b00fad2b6a82" status: 202 len: 0 microversion: 2.1 time: 0.061943 Sep 30 19:41:00.033678 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 522/1084] 10.222.0.17 () {58 vars in 1248 bytes} [Fri Sep 30 19:40:59 2022] DELETE /compute/v2.1/os-volumes/8c32126e-3465-40c7-8942-b00fad2b6a82 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 30 19:41:00.041728 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-fad63367-c4bc-4f1a-838f-86eee067702f tempest-VolumesGetTestJSON-777457834 tempest-VolumesGetTestJSON-777457834-project] Calling method '.version_select at 0x7f622279e940>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:41:00.092601 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-fad63367-c4bc-4f1a-838f-86eee067702f tempest-VolumesGetTestJSON-777457834 tempest-VolumesGetTestJSON-777457834-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/8c32126e-3465-40c7-8942-b00fad2b6a82" status: 200 len: 353 microversion: 2.1 time: 0.054490 Sep 30 19:41:00.097794 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 563/1085] 10.222.0.17 () {58 vars in 1245 bytes} [Fri Sep 30 19:41:00 2022] GET /compute/v2.1/os-volumes/8c32126e-3465-40c7-8942-b00fad2b6a82 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:41:00.523233 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-2a65876e-ec9a-4e13-a0b7-419c35ff948a tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:41:00.523958 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-2a65876e-ec9a-4e13-a0b7-419c35ff948a tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] [instance: 8cf27336-b00a-4fc7-ab9e-e5c8116d41e4] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:41:00.529927 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2a65876e-ec9a-4e13-a0b7-419c35ff948a tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:00.530412 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2a65876e-ec9a-4e13-a0b7-419c35ff948a tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:00.530848 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2a65876e-ec9a-4e13-a0b7-419c35ff948a tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:00.531540 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2a65876e-ec9a-4e13-a0b7-419c35ff948a tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:00.531996 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2a65876e-ec9a-4e13-a0b7-419c35ff948a tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:00.532445 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2a65876e-ec9a-4e13-a0b7-419c35ff948a tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:00.562594 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [req-2be681ea-cf44-4e47-98c5-7b19de38d0bd req-ca98bf3c-4ab2-41d0-9256-e4167e24c1d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cf27336-b00a-4fc7-ab9e-e5c8116d41e4", "name": "network-vif-plugged", "status": "completed", "tag": "e8570c00-a37a-4350-8728-48685d65618a"}]} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:41:00.576549 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-2be681ea-cf44-4e47-98c5-7b19de38d0bd req-ca98bf3c-4ab2-41d0-9256-e4167e24c1d7 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:00.576549 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-2be681ea-cf44-4e47-98c5-7b19de38d0bd req-ca98bf3c-4ab2-41d0-9256-e4167e24c1d7 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:00.576549 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-2be681ea-cf44-4e47-98c5-7b19de38d0bd req-ca98bf3c-4ab2-41d0-9256-e4167e24c1d7 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:00.586887 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.compute.server_external_events [req-2be681ea-cf44-4e47-98c5-7b19de38d0bd req-ca98bf3c-4ab2-41d0-9256-e4167e24c1d7 service nova] Creating event network-vif-plugged:e8570c00-a37a-4350-8728-48685d65618a for instance 8cf27336-b00a-4fc7-ab9e-e5c8116d41e4 on hv-cinder-86001 Sep 30 19:41:00.592033 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [req-2be681ea-cf44-4e47-98c5-7b19de38d0bd req-ca98bf3c-4ab2-41d0-9256-e4167e24c1d7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033715 Sep 30 19:41:00.592761 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 564/1086] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:41:00.664990 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-2a65876e-ec9a-4e13-a0b7-419c35ff948a tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b46acc6b57473fa4cab2e37b761748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb45af355274456bc3759ebb76f6b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:41:00.673021 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-2a65876e-ec9a-4e13-a0b7-419c35ff948a tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] 10.222.0.17 "GET /compute/v2.1/servers/8cf27336-b00a-4fc7-ab9e-e5c8116d41e4" status: 200 len: 1319 microversion: 2.1 time: 0.153299 Sep 30 19:41:00.673650 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 523/1087] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:41:00 2022] GET /compute/v2.1/servers/8cf27336-b00a-4fc7-ab9e-e5c8116d41e4 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:41:01.107623 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-655f2b3a-6fb1-4215-91b6-d9e8336b2cf5 tempest-VolumesGetTestJSON-777457834 tempest-VolumesGetTestJSON-777457834-project] Calling method '.version_select at 0x7f6222777820>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:41:01.135494 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.wsgi [None req-655f2b3a-6fb1-4215-91b6-d9e8336b2cf5 tempest-VolumesGetTestJSON-777457834 tempest-VolumesGetTestJSON-777457834-project] HTTP exception thrown: Volume 8c32126e-3465-40c7-8942-b00fad2b6a82 could not be found. Sep 30 19:41:01.138808 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-655f2b3a-6fb1-4215-91b6-d9e8336b2cf5 tempest-VolumesGetTestJSON-777457834 tempest-VolumesGetTestJSON-777457834-project] Request method failure captured: Sep 30 19:41:01.138808 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: request: GET /compute/v2.1/os-volumes/8c32126e-3465-40c7-8942-b00fad2b6a82 HTTP/1.1 Sep 30 19:41:01.138808 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Accept: application/json Sep 30 19:41:01.138808 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Accept-Encoding: identity Sep 30 19:41:01.138808 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Connection: close Sep 30 19:41:01.138808 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Content-Length: 0 Sep 30 19:41:01.138808 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Content-Type: application/json Sep 30 19:41:01.138808 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Host: 10.222.0.17 Sep 30 19:41:01.138808 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Openstack-System-Scope: None Sep 30 19:41:01.138808 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: User-Agent: python-urllib3/1.26.12 Sep 30 19:41:01.138808 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Auth-Token: gAAAAABjN0ZKSRidS9_9J2ZMypoMwyUN7WGMU8gPK2EOauKgZ--2S1tOY4zd6P_PtG0Pq4ASczsUeXZHsjiJqDffA7Ky4uWcnA8GbHEaUrfMAygI1ueojzIZtqcMjtuz9AQ216sbZ5nWktRPHEVYk3zg9L1JonYBJEAWxIZO9lRFmVxARL9vrvQ Sep 30 19:41:01.138808 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Domain-Id: None Sep 30 19:41:01.138808 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Domain-Name: None Sep 30 19:41:01.138808 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Identity-Status: Confirmed Sep 30 19:41:01.138808 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Is-Admin-Project: True Sep 30 19:41:01.138808 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Domain-Id: default Sep 30 19:41:01.138808 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Domain-Name: Default Sep 30 19:41:01.138808 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Id: 5b6ad3c6bda647e4af491892cebf82a1 Sep 30 19:41:01.138808 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Name: tempest-VolumesGetTestJSON-777457834 Sep 30 19:41:01.138808 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Role: member,reader Sep 30 19:41:01.138808 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Roles: member,reader Sep 30 19:41:01.140515 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5b6ad3c6bda647e4af491892cebf82a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5b6ad3c6bda647e4af491892cebf82a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5b6ad3c6bda647e4af491892cebf82a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5b6ad3c6bda647e4af491892cebf82a1"}]}] Sep 30 19:41:01.140515 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant: tempest-VolumesGetTestJSON-777457834 Sep 30 19:41:01.140515 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant-Id: 5b6ad3c6bda647e4af491892cebf82a1 Sep 30 19:41:01.140515 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant-Name: tempest-VolumesGetTestJSON-777457834 Sep 30 19:41:01.140515 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User: tempest-VolumesGetTestJSON-777457834-project Sep 30 19:41:01.140515 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Domain-Id: default Sep 30 19:41:01.140515 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Domain-Name: Default Sep 30 19:41:01.140515 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Id: d9ba795f1d4841e883e762aec293f32a Sep 30 19:41:01.140515 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Name: tempest-VolumesGetTestJSON-777457834-project Sep 30 19:41:01.140515 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: method: Sep 30 19:41:01.140515 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: exception: Volume 8c32126e-3465-40c7-8942-b00fad2b6a82 could not be found. Sep 30 19:41:01.140515 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: action_args: {'id': '8c32126e-3465-40c7-8942-b00fad2b6a82'} Sep 30 19:41:01.140515 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:41:01.141599 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:41:01.141599 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 30 19:41:01.141599 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 30 19:41:01.141599 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 30 19:41:01.141599 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 30 19:41:01.141599 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 30 19:41:01.141599 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 30 19:41:01.141599 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 30 19:41:01.141599 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 30 19:41:01.141599 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 30 19:41:01.141599 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 30 19:41:01.141599 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 30 19:41:01.141599 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 30 19:41:01.141599 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 30 19:41:01.141599 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 30 19:41:01.141599 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8c32126e-3465-40c7-8942-b00fad2b6a82 could not be found. (HTTP 404) (Request-ID: req-49f1027a-0d47-43fc-b992-00600c153de5) Sep 30 19:41:01.141599 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:41:01.141599 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:41:01.141599 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:41:01.143086 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:41:01.143086 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 30 19:41:01.143086 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 30 19:41:01.143086 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 30 19:41:01.143086 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 30 19:41:01.143086 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 30 19:41:01.143086 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 30 19:41:01.143086 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 30 19:41:01.143086 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 30 19:41:01.143086 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 30 19:41:01.143086 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 30 19:41:01.143086 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 30 19:41:01.143086 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 30 19:41:01.143086 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 30 19:41:01.143086 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 30 19:41:01.143086 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 30 19:41:01.143086 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 30 19:41:01.143086 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 30 19:41:01.143086 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 30 19:41:01.144692 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 30 19:41:01.144692 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 30 19:41:01.144692 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 30 19:41:01.144692 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 30 19:41:01.144692 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8c32126e-3465-40c7-8942-b00fad2b6a82 could not be found. Sep 30 19:41:01.144692 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:41:01.144692 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:41:01.144692 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:41:01.144692 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:41:01.144692 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:41:01.144692 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:41:01.144692 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:41:01.144692 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:41:01.144692 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 30 19:41:01.144692 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 30 19:41:01.144692 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:41:01.144692 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:41:01.144692 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 30 19:41:01.144692 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 30 19:41:01.146129 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8c32126e-3465-40c7-8942-b00fad2b6a82 could not be found. Sep 30 19:41:01.146129 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:41:01.146129 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:41:01.146129 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:41:01.146129 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:41:01.146129 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:41:01.146129 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:41:01.146129 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:41:01.146129 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:41:01.146129 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8c32126e-3465-40c7-8942-b00fad2b6a82 could not be found. Sep 30 19:41:01.146129 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:41:01.146129 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-655f2b3a-6fb1-4215-91b6-d9e8336b2cf5 tempest-VolumesGetTestJSON-777457834 tempest-VolumesGetTestJSON-777457834-project] Returning 404 to user: Volume 8c32126e-3465-40c7-8942-b00fad2b6a82 could not be found. {{(pid=120649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:41:01.146129 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-655f2b3a-6fb1-4215-91b6-d9e8336b2cf5 tempest-VolumesGetTestJSON-777457834 tempest-VolumesGetTestJSON-777457834-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/8c32126e-3465-40c7-8942-b00fad2b6a82" status: 404 len: 109 microversion: 2.1 time: 0.036954 Sep 30 19:41:01.146129 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 565/1088] 10.222.0.17 () {58 vars in 1245 bytes} [Fri Sep 30 19:41:01 2022] GET /compute/v2.1/os-volumes/8c32126e-3465-40c7-8942-b00fad2b6a82 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 30 19:41:01.696956 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-49fa9868-11c9-4c37-9881-959039323bd0 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:41:01.697762 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-49fa9868-11c9-4c37-9881-959039323bd0 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] [instance: 8cf27336-b00a-4fc7-ab9e-e5c8116d41e4] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:41:01.705099 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-49fa9868-11c9-4c37-9881-959039323bd0 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:01.705581 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-49fa9868-11c9-4c37-9881-959039323bd0 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:01.706025 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-49fa9868-11c9-4c37-9881-959039323bd0 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:01.706738 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-49fa9868-11c9-4c37-9881-959039323bd0 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:01.707195 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-49fa9868-11c9-4c37-9881-959039323bd0 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:01.707767 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-49fa9868-11c9-4c37-9881-959039323bd0 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:01.844103 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-49fa9868-11c9-4c37-9881-959039323bd0 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b46acc6b57473fa4cab2e37b761748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb45af355274456bc3759ebb76f6b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:41:01.851758 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-49fa9868-11c9-4c37-9881-959039323bd0 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] 10.222.0.17 "GET /compute/v2.1/servers/8cf27336-b00a-4fc7-ab9e-e5c8116d41e4" status: 200 len: 1319 microversion: 2.1 time: 0.158760 Sep 30 19:41:01.852326 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 524/1089] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:41:01 2022] GET /compute/v2.1/servers/8cf27336-b00a-4fc7-ab9e-e5c8116d41e4 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:41:02.870781 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell0:SELECT=2 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:41:02.871537 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell0:SELECT=6 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:41:02.876492 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-59434c7b-0dff-4332-8632-461448601798 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:41:02.877242 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-59434c7b-0dff-4332-8632-461448601798 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] [instance: 8cf27336-b00a-4fc7-ab9e-e5c8116d41e4] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:41:02.884617 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-59434c7b-0dff-4332-8632-461448601798 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:02.885238 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-59434c7b-0dff-4332-8632-461448601798 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:02.885726 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-59434c7b-0dff-4332-8632-461448601798 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:02.886549 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-59434c7b-0dff-4332-8632-461448601798 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:02.887187 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-59434c7b-0dff-4332-8632-461448601798 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:02.887487 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-59434c7b-0dff-4332-8632-461448601798 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:03.023575 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-59434c7b-0dff-4332-8632-461448601798 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b46acc6b57473fa4cab2e37b761748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb45af355274456bc3759ebb76f6b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:41:03.030549 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-59434c7b-0dff-4332-8632-461448601798 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] 10.222.0.17 "GET /compute/v2.1/servers/8cf27336-b00a-4fc7-ab9e-e5c8116d41e4" status: 200 len: 1509 microversion: 2.1 time: 0.161181 Sep 30 19:41:03.031119 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 566/1090] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:41:02 2022] GET /compute/v2.1/servers/8cf27336-b00a-4fc7-ab9e-e5c8116d41e4 => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:41:23.327003 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-c3e701ef-a172-4ba2-a851-9e8aaba99abd tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:41:23.327520 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-c3e701ef-a172-4ba2-a851-9e8aaba99abd tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: 9a0cc547-90fa-43de-b4f6-b1653194be5e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:41:23.329391 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=2 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:41:23.330488 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=7 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:41:23.331191 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=23 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:41:23.338285 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c3e701ef-a172-4ba2-a851-9e8aaba99abd tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:23.338767 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c3e701ef-a172-4ba2-a851-9e8aaba99abd tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:23.339200 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c3e701ef-a172-4ba2-a851-9e8aaba99abd tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:23.339887 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c3e701ef-a172-4ba2-a851-9e8aaba99abd tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:23.340339 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c3e701ef-a172-4ba2-a851-9e8aaba99abd tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:23.340793 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c3e701ef-a172-4ba2-a851-9e8aaba99abd tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:23.367515 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-c3e701ef-a172-4ba2-a851-9e8aaba99abd tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: 9a0cc547-90fa-43de-b4f6-b1653194be5e] Going to try to terminate instance {{(pid=120648) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 30 19:41:23.441638 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-c3e701ef-a172-4ba2-a851-9e8aaba99abd tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "DELETE /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e" status: 204 len: 0 microversion: 2.1 time: 0.118373 Sep 30 19:41:23.442292 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 525/1091] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 30 19:41:23 2022] DELETE /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 30 19:41:23.450802 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-94ce895f-25af-477f-bf8f-a8a36965d9c8 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:41:23.451417 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-94ce895f-25af-477f-bf8f-a8a36965d9c8 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: 9a0cc547-90fa-43de-b4f6-b1653194be5e] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:41:23.453780 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_api:SELECT=9 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:41:23.454532 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell1:SELECT=21 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:41:23.460547 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-94ce895f-25af-477f-bf8f-a8a36965d9c8 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:23.461010 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-94ce895f-25af-477f-bf8f-a8a36965d9c8 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:23.461454 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-94ce895f-25af-477f-bf8f-a8a36965d9c8 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:23.462151 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-94ce895f-25af-477f-bf8f-a8a36965d9c8 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:23.462606 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-94ce895f-25af-477f-bf8f-a8a36965d9c8 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:23.463027 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-94ce895f-25af-477f-bf8f-a8a36965d9c8 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:23.589932 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-94ce895f-25af-477f-bf8f-a8a36965d9c8 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:41:23.597541 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-94ce895f-25af-477f-bf8f-a8a36965d9c8 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e" status: 200 len: 1579 microversion: 2.1 time: 0.150557 Sep 30 19:41:23.598103 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 567/1092] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:41:23 2022] GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e => generated 1579 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:41:24.622148 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-0f138c0c-fc91-44d5-bebf-d3dcfb576985 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:41:24.622845 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-0f138c0c-fc91-44d5-bebf-d3dcfb576985 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: 9a0cc547-90fa-43de-b4f6-b1653194be5e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:41:24.629112 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0f138c0c-fc91-44d5-bebf-d3dcfb576985 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:24.629592 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0f138c0c-fc91-44d5-bebf-d3dcfb576985 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:24.630021 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0f138c0c-fc91-44d5-bebf-d3dcfb576985 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:24.630700 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0f138c0c-fc91-44d5-bebf-d3dcfb576985 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:24.631149 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0f138c0c-fc91-44d5-bebf-d3dcfb576985 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:24.632232 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0f138c0c-fc91-44d5-bebf-d3dcfb576985 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:24.764962 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-0f138c0c-fc91-44d5-bebf-d3dcfb576985 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:41:24.772632 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-0f138c0c-fc91-44d5-bebf-d3dcfb576985 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e" status: 200 len: 1579 microversion: 2.1 time: 0.154576 Sep 30 19:41:24.773186 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 526/1093] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:41:24 2022] GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e => generated 1579 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:41:25.796610 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-ede5d8d4-30f2-46fd-9093-c96a3ad3fa55 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:41:25.797224 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-ede5d8d4-30f2-46fd-9093-c96a3ad3fa55 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: 9a0cc547-90fa-43de-b4f6-b1653194be5e] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:41:25.803164 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ede5d8d4-30f2-46fd-9093-c96a3ad3fa55 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:25.804331 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ede5d8d4-30f2-46fd-9093-c96a3ad3fa55 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:25.804794 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ede5d8d4-30f2-46fd-9093-c96a3ad3fa55 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:25.805493 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ede5d8d4-30f2-46fd-9093-c96a3ad3fa55 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:25.805949 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ede5d8d4-30f2-46fd-9093-c96a3ad3fa55 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:25.806375 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ede5d8d4-30f2-46fd-9093-c96a3ad3fa55 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:25.933540 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-ede5d8d4-30f2-46fd-9093-c96a3ad3fa55 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:41:25.941203 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-ede5d8d4-30f2-46fd-9093-c96a3ad3fa55 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e" status: 200 len: 1579 microversion: 2.1 time: 0.148701 Sep 30 19:41:25.941766 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 568/1094] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:41:25 2022] GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e => generated 1579 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:41:26.964075 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-0fc7a01d-f39b-4d66-835c-a167116b70f4 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:41:26.964703 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-0fc7a01d-f39b-4d66-835c-a167116b70f4 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: 9a0cc547-90fa-43de-b4f6-b1653194be5e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:41:26.971101 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0fc7a01d-f39b-4d66-835c-a167116b70f4 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:26.971574 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0fc7a01d-f39b-4d66-835c-a167116b70f4 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:26.972002 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0fc7a01d-f39b-4d66-835c-a167116b70f4 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:26.972715 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0fc7a01d-f39b-4d66-835c-a167116b70f4 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:26.973165 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0fc7a01d-f39b-4d66-835c-a167116b70f4 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:26.973583 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0fc7a01d-f39b-4d66-835c-a167116b70f4 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:27.105764 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-0fc7a01d-f39b-4d66-835c-a167116b70f4 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:41:27.113398 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-0fc7a01d-f39b-4d66-835c-a167116b70f4 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e" status: 200 len: 1579 microversion: 2.1 time: 0.153341 Sep 30 19:41:27.113979 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 527/1095] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:41:26 2022] GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e => generated 1579 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:41:28.137726 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-c81f15bb-08ce-4800-9aff-2faae34c88fe tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:41:28.138337 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-c81f15bb-08ce-4800-9aff-2faae34c88fe tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: 9a0cc547-90fa-43de-b4f6-b1653194be5e] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:41:28.144873 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c81f15bb-08ce-4800-9aff-2faae34c88fe tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:28.145357 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c81f15bb-08ce-4800-9aff-2faae34c88fe tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:28.145797 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c81f15bb-08ce-4800-9aff-2faae34c88fe tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:28.146493 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c81f15bb-08ce-4800-9aff-2faae34c88fe tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:28.146945 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c81f15bb-08ce-4800-9aff-2faae34c88fe tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:28.147375 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c81f15bb-08ce-4800-9aff-2faae34c88fe tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:28.281589 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-c81f15bb-08ce-4800-9aff-2faae34c88fe tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:41:28.289636 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-c81f15bb-08ce-4800-9aff-2faae34c88fe tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e" status: 200 len: 1579 microversion: 2.1 time: 0.155946 Sep 30 19:41:28.290189 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 569/1096] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:41:28 2022] GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e => generated 1579 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:41:29.313737 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-ca644f9e-b152-4f3c-8e8b-557fd8484892 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:41:29.314264 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-ca644f9e-b152-4f3c-8e8b-557fd8484892 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: 9a0cc547-90fa-43de-b4f6-b1653194be5e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:41:29.320609 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ca644f9e-b152-4f3c-8e8b-557fd8484892 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:29.321093 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ca644f9e-b152-4f3c-8e8b-557fd8484892 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:29.321532 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ca644f9e-b152-4f3c-8e8b-557fd8484892 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:29.322226 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ca644f9e-b152-4f3c-8e8b-557fd8484892 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:29.322681 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ca644f9e-b152-4f3c-8e8b-557fd8484892 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:29.323111 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ca644f9e-b152-4f3c-8e8b-557fd8484892 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:29.392431 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-ca644f9e-b152-4f3c-8e8b-557fd8484892 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:41:29.401431 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-ca644f9e-b152-4f3c-8e8b-557fd8484892 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e" status: 200 len: 1511 microversion: 2.1 time: 0.091547 Sep 30 19:41:29.402014 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 528/1097] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:41:29 2022] GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e => generated 1511 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:41:29.660321 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [req-597a1626-e245-42db-a656-da157b612421 req-ba0a0d8b-6ec3-4222-8cff-4055d73fd021 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a0cc547-90fa-43de-b4f6-b1653194be5e", "name": "network-vif-deleted", "tag": "c7257cd3-8682-4d80-8650-53ef46de5429"}]} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:41:29.679052 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-597a1626-e245-42db-a656-da157b612421 req-ba0a0d8b-6ec3-4222-8cff-4055d73fd021 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:29.679544 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-597a1626-e245-42db-a656-da157b612421 req-ba0a0d8b-6ec3-4222-8cff-4055d73fd021 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:29.679974 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-597a1626-e245-42db-a656-da157b612421 req-ba0a0d8b-6ec3-4222-8cff-4055d73fd021 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:29.695587 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.compute.server_external_events [req-597a1626-e245-42db-a656-da157b612421 req-ba0a0d8b-6ec3-4222-8cff-4055d73fd021 service nova] Creating event network-vif-deleted:c7257cd3-8682-4d80-8650-53ef46de5429 for instance 9a0cc547-90fa-43de-b4f6-b1653194be5e on hv-cinder-86001 Sep 30 19:41:29.701043 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [req-597a1626-e245-42db-a656-da157b612421 req-ba0a0d8b-6ec3-4222-8cff-4055d73fd021 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044762 Sep 30 19:41:29.701664 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 570/1098] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:41:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:41:30.426194 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-abafc6e2-51fa-4cec-9f0d-cad972c1fb9c tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:41:30.426809 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-abafc6e2-51fa-4cec-9f0d-cad972c1fb9c tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: 9a0cc547-90fa-43de-b4f6-b1653194be5e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:41:30.433351 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-abafc6e2-51fa-4cec-9f0d-cad972c1fb9c tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:30.433842 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-abafc6e2-51fa-4cec-9f0d-cad972c1fb9c tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:30.434281 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-abafc6e2-51fa-4cec-9f0d-cad972c1fb9c tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:30.434987 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-abafc6e2-51fa-4cec-9f0d-cad972c1fb9c tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:30.435439 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-abafc6e2-51fa-4cec-9f0d-cad972c1fb9c tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:30.435863 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-abafc6e2-51fa-4cec-9f0d-cad972c1fb9c tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:30.499563 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-abafc6e2-51fa-4cec-9f0d-cad972c1fb9c tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:41:30.507601 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-abafc6e2-51fa-4cec-9f0d-cad972c1fb9c tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e" status: 200 len: 1225 microversion: 2.1 time: 0.085362 Sep 30 19:41:30.508184 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 529/1099] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:41:30 2022] GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:41:31.532341 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-d42ad6ad-bb94-4de2-b9d6-065834fa95c1 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:41:31.533505 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-d42ad6ad-bb94-4de2-b9d6-065834fa95c1 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: 9a0cc547-90fa-43de-b4f6-b1653194be5e] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:41:31.542288 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d42ad6ad-bb94-4de2-b9d6-065834fa95c1 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:31.542767 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d42ad6ad-bb94-4de2-b9d6-065834fa95c1 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:31.543201 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d42ad6ad-bb94-4de2-b9d6-065834fa95c1 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:31.543888 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d42ad6ad-bb94-4de2-b9d6-065834fa95c1 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:31.544339 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d42ad6ad-bb94-4de2-b9d6-065834fa95c1 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:31.544787 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d42ad6ad-bb94-4de2-b9d6-065834fa95c1 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:31.605061 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-d42ad6ad-bb94-4de2-b9d6-065834fa95c1 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:41:31.612561 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-d42ad6ad-bb94-4de2-b9d6-065834fa95c1 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e" status: 200 len: 1225 microversion: 2.1 time: 0.085327 Sep 30 19:41:31.613119 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 571/1100] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:41:31 2022] GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:41:32.635468 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-9e9aa5ba-fc02-4bd1-84a8-0eaed01fb7d9 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:41:32.636071 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-9e9aa5ba-fc02-4bd1-84a8-0eaed01fb7d9 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: 9a0cc547-90fa-43de-b4f6-b1653194be5e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:41:32.642446 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9e9aa5ba-fc02-4bd1-84a8-0eaed01fb7d9 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:32.642926 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9e9aa5ba-fc02-4bd1-84a8-0eaed01fb7d9 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:32.643360 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9e9aa5ba-fc02-4bd1-84a8-0eaed01fb7d9 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:32.644044 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9e9aa5ba-fc02-4bd1-84a8-0eaed01fb7d9 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:32.644537 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9e9aa5ba-fc02-4bd1-84a8-0eaed01fb7d9 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:32.646667 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9e9aa5ba-fc02-4bd1-84a8-0eaed01fb7d9 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:32.708028 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-9e9aa5ba-fc02-4bd1-84a8-0eaed01fb7d9 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:41:32.716423 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-9e9aa5ba-fc02-4bd1-84a8-0eaed01fb7d9 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e" status: 200 len: 1225 microversion: 2.1 time: 0.084808 Sep 30 19:41:32.716982 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 530/1101] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:41:32 2022] GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:41:33.739775 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-863d9aed-69f5-44b0-ab2a-a4ce003b2967 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:41:33.740410 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-863d9aed-69f5-44b0-ab2a-a4ce003b2967 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: 9a0cc547-90fa-43de-b4f6-b1653194be5e] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:41:33.747501 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-863d9aed-69f5-44b0-ab2a-a4ce003b2967 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:33.747983 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-863d9aed-69f5-44b0-ab2a-a4ce003b2967 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:33.748440 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-863d9aed-69f5-44b0-ab2a-a4ce003b2967 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:33.749130 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-863d9aed-69f5-44b0-ab2a-a4ce003b2967 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:33.749582 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-863d9aed-69f5-44b0-ab2a-a4ce003b2967 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:33.750007 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-863d9aed-69f5-44b0-ab2a-a4ce003b2967 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:33.810747 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-863d9aed-69f5-44b0-ab2a-a4ce003b2967 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:41:33.818332 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-863d9aed-69f5-44b0-ab2a-a4ce003b2967 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e" status: 200 len: 1225 microversion: 2.1 time: 0.082444 Sep 30 19:41:33.818939 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 572/1102] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:41:33 2022] GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:41:34.841057 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-6793915e-1bde-41c6-a79b-ee7fbb3f457b tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:41:34.841670 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-6793915e-1bde-41c6-a79b-ee7fbb3f457b tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: 9a0cc547-90fa-43de-b4f6-b1653194be5e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:41:34.848358 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6793915e-1bde-41c6-a79b-ee7fbb3f457b tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:34.848876 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6793915e-1bde-41c6-a79b-ee7fbb3f457b tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:34.849312 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6793915e-1bde-41c6-a79b-ee7fbb3f457b tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:34.850001 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6793915e-1bde-41c6-a79b-ee7fbb3f457b tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:34.851100 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6793915e-1bde-41c6-a79b-ee7fbb3f457b tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:34.851528 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6793915e-1bde-41c6-a79b-ee7fbb3f457b tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:34.914136 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-6793915e-1bde-41c6-a79b-ee7fbb3f457b tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:41:34.921836 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-6793915e-1bde-41c6-a79b-ee7fbb3f457b tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e" status: 200 len: 1225 microversion: 2.1 time: 0.084648 Sep 30 19:41:34.922403 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 531/1103] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:41:34 2022] GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:41:35.944442 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-9a870ada-f7e1-488a-9588-95646b8cb607 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:41:35.945055 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-9a870ada-f7e1-488a-9588-95646b8cb607 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: 9a0cc547-90fa-43de-b4f6-b1653194be5e] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:41:35.951801 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9a870ada-f7e1-488a-9588-95646b8cb607 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:35.952287 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9a870ada-f7e1-488a-9588-95646b8cb607 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:35.952750 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9a870ada-f7e1-488a-9588-95646b8cb607 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:35.953450 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9a870ada-f7e1-488a-9588-95646b8cb607 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:35.954089 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9a870ada-f7e1-488a-9588-95646b8cb607 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:35.954671 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9a870ada-f7e1-488a-9588-95646b8cb607 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:36.026025 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-9a870ada-f7e1-488a-9588-95646b8cb607 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:41:36.033833 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-9a870ada-f7e1-488a-9588-95646b8cb607 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e" status: 200 len: 1225 microversion: 2.1 time: 0.093560 Sep 30 19:41:36.034527 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 573/1104] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:41:35 2022] GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:41:37.059358 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-3cfc7c2c-97ce-4983-a08f-6a25fa7c394f tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:41:37.060299 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-3cfc7c2c-97ce-4983-a08f-6a25fa7c394f tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: 9a0cc547-90fa-43de-b4f6-b1653194be5e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:41:37.070275 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3cfc7c2c-97ce-4983-a08f-6a25fa7c394f tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:37.071056 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3cfc7c2c-97ce-4983-a08f-6a25fa7c394f tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:37.071697 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3cfc7c2c-97ce-4983-a08f-6a25fa7c394f tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:37.072796 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3cfc7c2c-97ce-4983-a08f-6a25fa7c394f tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:37.073498 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3cfc7c2c-97ce-4983-a08f-6a25fa7c394f tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:37.074146 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3cfc7c2c-97ce-4983-a08f-6a25fa7c394f tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:37.096434 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.wsgi [None req-3cfc7c2c-97ce-4983-a08f-6a25fa7c394f tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] HTTP exception thrown: Instance 9a0cc547-90fa-43de-b4f6-b1653194be5e could not be found. Sep 30 19:41:37.098112 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-3cfc7c2c-97ce-4983-a08f-6a25fa7c394f tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Request method failure captured: Sep 30 19:41:37.098112 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: request: GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e HTTP/1.1 Sep 30 19:41:37.098112 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 30 19:41:37.098112 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 30 19:41:37.098112 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Connection: close Sep 30 19:41:37.098112 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Length: 0 Sep 30 19:41:37.098112 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 30 19:41:37.098112 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Host: 10.222.0.17 Sep 30 19:41:37.098112 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 30 19:41:37.098112 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 30 19:41:37.098112 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjN0WYog4ewqhpzDYMKJOk-jSueKDk3dvRdfwv4lcXuEz3D3wYQslucMkNqFipvDqlsEM4axRDbuCPAwlgKMMryNYmyT5a97xIFCUCZ2K1mz6d35kIyvQKc2M43GfAugRNLxMvzrpY0EcQcsrejcxXAIFctCgXJr6JoykiXCj5NqdCa2w Sep 30 19:41:37.098112 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 30 19:41:37.098112 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 30 19:41:37.098112 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 30 19:41:37.098112 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 30 19:41:37.098112 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 30 19:41:37.098112 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 30 19:41:37.098112 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Id: 267f4c2e27aa4f9db62c3877d948f3d9 Sep 30 19:41:37.098112 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-TestVolumeBootPattern-2055047970 Sep 30 19:41:37.098112 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 30 19:41:37.098112 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 30 19:41:37.099663 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/267f4c2e27aa4f9db62c3877d948f3d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/267f4c2e27aa4f9db62c3877d948f3d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/267f4c2e27aa4f9db62c3877d948f3d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_267f4c2e27aa4f9db62c3877d948f3d9"}]}] Sep 30 19:41:37.099663 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-TestVolumeBootPattern-2055047970 Sep 30 19:41:37.099663 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Id: 267f4c2e27aa4f9db62c3877d948f3d9 Sep 30 19:41:37.099663 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-TestVolumeBootPattern-2055047970 Sep 30 19:41:37.099663 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User: tempest-TestVolumeBootPattern-2055047970-project Sep 30 19:41:37.099663 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 30 19:41:37.099663 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 30 19:41:37.099663 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Id: eccbf92faf2b4bad8746a2a48f5a6226 Sep 30 19:41:37.099663 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-TestVolumeBootPattern-2055047970-project Sep 30 19:41:37.099663 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: method: > Sep 30 19:41:37.099663 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: exception: Instance 9a0cc547-90fa-43de-b4f6-b1653194be5e could not be found. Sep 30 19:41:37.099663 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: action_args: {'id': '9a0cc547-90fa-43de-b4f6-b1653194be5e'} Sep 30 19:41:37.100954 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:41:37.100954 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:41:37.100954 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 30 19:41:37.100954 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 30 19:41:37.100954 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 30 19:41:37.100954 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 30 19:41:37.100954 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 30 19:41:37.100954 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 30 19:41:37.100954 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 30 19:41:37.100954 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 30 19:41:37.100954 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a0cc547-90fa-43de-b4f6-b1653194be5e could not be found. Sep 30 19:41:37.100954 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:41:37.100954 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:41:37.100954 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:41:37.100954 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:41:37.100954 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:41:37.100954 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:41:37.100954 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:41:37.100954 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:41:37.100954 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:41:37.102895 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:41:37.102895 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 30 19:41:37.102895 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 30 19:41:37.102895 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 30 19:41:37.102895 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 30 19:41:37.102895 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 30 19:41:37.102895 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 30 19:41:37.102895 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a0cc547-90fa-43de-b4f6-b1653194be5e could not be found. Sep 30 19:41:37.102895 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:41:37.102895 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:41:37.102895 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:41:37.102895 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:41:37.102895 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:41:37.102895 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:41:37.102895 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:41:37.102895 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:41:37.102895 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a0cc547-90fa-43de-b4f6-b1653194be5e could not be found. Sep 30 19:41:37.102895 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:41:37.106421 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-3cfc7c2c-97ce-4983-a08f-6a25fa7c394f tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Returning 404 to user: Instance 9a0cc547-90fa-43de-b4f6-b1653194be5e could not be found. {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:41:37.106421 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-3cfc7c2c-97ce-4983-a08f-6a25fa7c394f tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e" status: 404 len: 111 microversion: 2.1 time: 0.045295 Sep 30 19:41:37.111384 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 532/1105] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:41:37 2022] GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 30 19:41:37.209292 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-a5e02c14-d33f-4049-9c45-e555eb627b15 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1909588530", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-106744613", "security_groups": [{"name": "tempest-secgroup-smoke-1336083125"}], "block_device_mapping_v2": [{"uuid": "1ff97668-22a8-44ed-8122-0ffbc6f60320", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5eacc127-b1a0-451d-80fc-349e698deff5"}]}} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:41:37.216353 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e281eece-7b9f-4f6d-bcd0-4934cf90db62 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "08695ed7-b573-4303-b517-6f82ea2141f0", "device": "/dev/sdb"}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:41:37.220144 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-e281eece-7b9f-4f6d-bcd0-4934cf90db62 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] [instance: 8cf27336-b00a-4fc7-ab9e-e5c8116d41e4] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:41:37.229301 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e281eece-7b9f-4f6d-bcd0-4934cf90db62 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:37.230128 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e281eece-7b9f-4f6d-bcd0-4934cf90db62 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:37.230732 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e281eece-7b9f-4f6d-bcd0-4934cf90db62 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:37.231620 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e281eece-7b9f-4f6d-bcd0-4934cf90db62 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:37.232077 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e281eece-7b9f-4f6d-bcd0-4934cf90db62 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:37.232562 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e281eece-7b9f-4f6d-bcd0-4934cf90db62 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:37.345242 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.network.neutron [None req-a5e02c14-d33f-4049-9c45-e555eb627b15 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] validate_networks() for [('5eacc127-b1a0-451d-80fc-349e698deff5', None, None, None, None, None)] {{(pid=120649) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 30 19:41:37.536426 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-e281eece-7b9f-4f6d-bcd0-4934cf90db62 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] 10.222.0.17 "POST /compute/v2.1/servers/8cf27336-b00a-4fc7-ab9e-e5c8116d41e4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.324294 Sep 30 19:41:37.537527 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 533/1106] 10.222.0.17 () {60 vars in 1323 bytes} [Fri Sep 30 19:41:37 2022] POST /compute/v2.1/servers/8cf27336-b00a-4fc7-ab9e-e5c8116d41e4/os-volume_attachments => generated 194 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 30 19:41:37.730683 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.virt.hardware [None req-a5e02c14-d33f-4049-9c45-e555eb627b15 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Flavor limits 0:0:0 {{(pid=120649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 30 19:41:37.731124 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.virt.hardware [None req-a5e02c14-d33f-4049-9c45-e555eb627b15 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Image limits 0:0:0 {{(pid=120649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 30 19:41:37.731583 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.virt.hardware [None req-a5e02c14-d33f-4049-9c45-e555eb627b15 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Flavor pref 0:0:0 {{(pid=120649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 30 19:41:37.732022 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.virt.hardware [None req-a5e02c14-d33f-4049-9c45-e555eb627b15 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Image pref 0:0:0 {{(pid=120649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 30 19:41:37.732489 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.virt.hardware [None req-a5e02c14-d33f-4049-9c45-e555eb627b15 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 30 19:41:37.742345 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a5e02c14-d33f-4049-9c45-e555eb627b15 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:37.742852 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a5e02c14-d33f-4049-9c45-e555eb627b15 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:37.743292 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a5e02c14-d33f-4049-9c45-e555eb627b15 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:37.744025 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a5e02c14-d33f-4049-9c45-e555eb627b15 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:37.744508 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a5e02c14-d33f-4049-9c45-e555eb627b15 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:37.744938 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-a5e02c14-d33f-4049-9c45-e555eb627b15 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:37.762384 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.quota [None req-a5e02c14-d33f-4049-9c45-e555eb627b15 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Getting quotas for project 267f4c2e27aa4f9db62c3877d948f3d9. Resources: {'instances', 'ram', 'cores'} {{(pid=120649) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 30 19:41:37.766325 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.quota [None req-a5e02c14-d33f-4049-9c45-e555eb627b15 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Getting quotas for user eccbf92faf2b4bad8746a2a48f5a6226 and project 267f4c2e27aa4f9db62c3877d948f3d9. Resources: {'instances', 'ram', 'cores'} {{(pid=120649) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 30 19:41:37.822823 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-a5e02c14-d33f-4049-9c45-e555eb627b15 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Going to run 1 instances... {{(pid=120649) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 30 19:41:37.824938 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-a5e02c14-d33f-4049-9c45-e555eb627b15 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e9c06b75-e09a-4590-a6df-e8903fce4167] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1ff97668-22a8-44ed-8122-0ffbc6f60320',volume_size=None,volume_type=None)] {{(pid=120649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 30 19:41:37.948780 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-a5e02c14-d33f-4049-9c45-e555eb627b15 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.743697 Sep 30 19:41:37.949422 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 574/1107] 10.222.0.17 () {60 vars in 1147 bytes} [Fri Sep 30 19:41:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 30 19:41:37.961658 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-f21a169e-707c-440a-b790-cf90d621f303 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:41:37.962455 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-f21a169e-707c-440a-b790-cf90d621f303 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e9c06b75-e09a-4590-a6df-e8903fce4167] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:41:38.017445 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f21a169e-707c-440a-b790-cf90d621f303 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:41:38.025706 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-f21a169e-707c-440a-b790-cf90d621f303 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167" status: 200 len: 1094 microversion: 2.1 time: 0.068981 Sep 30 19:41:38.026271 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 534/1108] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:41:37 2022] GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167 => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:41:39.049503 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-5d83f9b1-9577-4c69-9d13-4072b5294bee tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:41:39.050119 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-5d83f9b1-9577-4c69-9d13-4072b5294bee tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e9c06b75-e09a-4590-a6df-e8903fce4167] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:41:39.056940 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5d83f9b1-9577-4c69-9d13-4072b5294bee tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:39.057462 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5d83f9b1-9577-4c69-9d13-4072b5294bee tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:39.057938 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5d83f9b1-9577-4c69-9d13-4072b5294bee tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:39.058628 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5d83f9b1-9577-4c69-9d13-4072b5294bee tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:39.059139 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5d83f9b1-9577-4c69-9d13-4072b5294bee tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:39.059612 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5d83f9b1-9577-4c69-9d13-4072b5294bee tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:39.126777 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-5d83f9b1-9577-4c69-9d13-4072b5294bee tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:41:39.135266 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-5d83f9b1-9577-4c69-9d13-4072b5294bee tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167" status: 200 len: 1144 microversion: 2.1 time: 0.090171 Sep 30 19:41:39.135943 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 575/1109] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:41:39 2022] GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167 => generated 1144 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:41:40.158226 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-72e6bd53-7e3d-451f-9710-53151913d6d6 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:41:40.158844 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-72e6bd53-7e3d-451f-9710-53151913d6d6 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e9c06b75-e09a-4590-a6df-e8903fce4167] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:41:40.166287 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-72e6bd53-7e3d-451f-9710-53151913d6d6 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:40.166776 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-72e6bd53-7e3d-451f-9710-53151913d6d6 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:40.167217 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-72e6bd53-7e3d-451f-9710-53151913d6d6 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:40.167907 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-72e6bd53-7e3d-451f-9710-53151913d6d6 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:40.168382 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-72e6bd53-7e3d-451f-9710-53151913d6d6 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:40.168817 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-72e6bd53-7e3d-451f-9710-53151913d6d6 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:40.234942 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-72e6bd53-7e3d-451f-9710-53151913d6d6 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:41:40.243456 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-72e6bd53-7e3d-451f-9710-53151913d6d6 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167" status: 200 len: 1144 microversion: 2.1 time: 0.089213 Sep 30 19:41:40.244014 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 535/1110] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:41:40 2022] GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167 => generated 1144 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:41:41.266313 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-5a06b411-a8cb-4fb5-926a-89fa1a15efa7 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:41:41.266927 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-5a06b411-a8cb-4fb5-926a-89fa1a15efa7 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e9c06b75-e09a-4590-a6df-e8903fce4167] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:41:41.273894 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5a06b411-a8cb-4fb5-926a-89fa1a15efa7 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:41.274375 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5a06b411-a8cb-4fb5-926a-89fa1a15efa7 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:41.274812 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5a06b411-a8cb-4fb5-926a-89fa1a15efa7 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:41.275496 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5a06b411-a8cb-4fb5-926a-89fa1a15efa7 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:41.275949 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5a06b411-a8cb-4fb5-926a-89fa1a15efa7 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:41.276391 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5a06b411-a8cb-4fb5-926a-89fa1a15efa7 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:41.338041 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-5a06b411-a8cb-4fb5-926a-89fa1a15efa7 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:41:41.345468 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-5a06b411-a8cb-4fb5-926a-89fa1a15efa7 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167" status: 200 len: 1144 microversion: 2.1 time: 0.083106 Sep 30 19:41:41.346033 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 576/1111] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:41:41 2022] GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167 => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:41:42.366951 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-1ebf0a6d-fbfa-43bd-93e0-215eac6b547c tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:41:42.367563 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-1ebf0a6d-fbfa-43bd-93e0-215eac6b547c tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e9c06b75-e09a-4590-a6df-e8903fce4167] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:41:42.373922 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1ebf0a6d-fbfa-43bd-93e0-215eac6b547c tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:42.374405 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1ebf0a6d-fbfa-43bd-93e0-215eac6b547c tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:42.374840 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1ebf0a6d-fbfa-43bd-93e0-215eac6b547c tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:42.375534 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1ebf0a6d-fbfa-43bd-93e0-215eac6b547c tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:42.375991 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1ebf0a6d-fbfa-43bd-93e0-215eac6b547c tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:42.376437 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1ebf0a6d-fbfa-43bd-93e0-215eac6b547c tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:42.437888 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-1ebf0a6d-fbfa-43bd-93e0-215eac6b547c tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:41:42.445373 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-1ebf0a6d-fbfa-43bd-93e0-215eac6b547c tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167" status: 200 len: 1192 microversion: 2.1 time: 0.082281 Sep 30 19:41:42.445945 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 536/1112] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:41:42 2022] GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167 => generated 1192 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:41:43.469456 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-9ab92210-f700-4e92-8278-bfb73037c055 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:41:43.470085 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-9ab92210-f700-4e92-8278-bfb73037c055 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e9c06b75-e09a-4590-a6df-e8903fce4167] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:41:43.476925 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9ab92210-f700-4e92-8278-bfb73037c055 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:43.477411 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9ab92210-f700-4e92-8278-bfb73037c055 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:43.477843 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9ab92210-f700-4e92-8278-bfb73037c055 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:43.478629 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9ab92210-f700-4e92-8278-bfb73037c055 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:43.479014 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9ab92210-f700-4e92-8278-bfb73037c055 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:43.479682 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9ab92210-f700-4e92-8278-bfb73037c055 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:43.687499 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-9ab92210-f700-4e92-8278-bfb73037c055 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:41:43.695356 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-9ab92210-f700-4e92-8278-bfb73037c055 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167" status: 200 len: 1278 microversion: 2.1 time: 0.230011 Sep 30 19:41:43.696007 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 577/1113] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:41:43 2022] GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167 => generated 1278 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:41:44.053034 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-0e8b53a7-db13-48c0-b3b5-bf0c3da44c57 req-f1647614-60d8-4f9a-874b-d75eb7046533 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9c06b75-e09a-4590-a6df-e8903fce4167", "tag": "c4655abc-d99b-4462-80dd-d51207134ed3"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:41:44.059479 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 30 19:41:44.059686 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Fri Sep 30 19:41:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.17) !!! Sep 30 19:41:44.072776 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-0e8b53a7-db13-48c0-b3b5-bf0c3da44c57 req-f1647614-60d8-4f9a-874b-d75eb7046533 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:44.073246 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-0e8b53a7-db13-48c0-b3b5-bf0c3da44c57 req-f1647614-60d8-4f9a-874b-d75eb7046533 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:44.073675 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-0e8b53a7-db13-48c0-b3b5-bf0c3da44c57 req-f1647614-60d8-4f9a-874b-d75eb7046533 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:44.084982 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-0e8b53a7-db13-48c0-b3b5-bf0c3da44c57 req-f1647614-60d8-4f9a-874b-d75eb7046533 service nova] Creating event network-changed:c4655abc-d99b-4462-80dd-d51207134ed3 for instance e9c06b75-e09a-4590-a6df-e8903fce4167 on hv-cinder-86001 Sep 30 19:41:44.089719 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-0e8b53a7-db13-48c0-b3b5-bf0c3da44c57 req-f1647614-60d8-4f9a-874b-d75eb7046533 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040423 Sep 30 19:41:44.090489 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 537/1114] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:41:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:41:44.718035 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-1b190729-477b-4ca3-955a-0c1430be586d tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:41:44.719263 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-1b190729-477b-4ca3-955a-0c1430be586d tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e9c06b75-e09a-4590-a6df-e8903fce4167] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:41:44.725445 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1b190729-477b-4ca3-955a-0c1430be586d tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:44.725935 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1b190729-477b-4ca3-955a-0c1430be586d tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:44.726375 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1b190729-477b-4ca3-955a-0c1430be586d tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:44.727705 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1b190729-477b-4ca3-955a-0c1430be586d tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:44.728302 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1b190729-477b-4ca3-955a-0c1430be586d tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:44.728963 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1b190729-477b-4ca3-955a-0c1430be586d tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:44.933412 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-1b190729-477b-4ca3-955a-0c1430be586d tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:41:44.943606 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-1b190729-477b-4ca3-955a-0c1430be586d tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167" status: 200 len: 1278 microversion: 2.1 time: 0.229291 Sep 30 19:41:44.944549 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 578/1115] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:41:44 2022] GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167 => generated 1278 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:41:45.969034 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-aeddefac-64b1-4ba8-b80f-345efe0b538d tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:41:45.969732 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-aeddefac-64b1-4ba8-b80f-345efe0b538d tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e9c06b75-e09a-4590-a6df-e8903fce4167] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:41:45.975746 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-aeddefac-64b1-4ba8-b80f-345efe0b538d tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:45.976224 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-aeddefac-64b1-4ba8-b80f-345efe0b538d tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:45.976680 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-aeddefac-64b1-4ba8-b80f-345efe0b538d tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:45.977360 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-aeddefac-64b1-4ba8-b80f-345efe0b538d tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:45.977809 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-aeddefac-64b1-4ba8-b80f-345efe0b538d tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:45.978231 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-aeddefac-64b1-4ba8-b80f-345efe0b538d tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:46.109505 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-aeddefac-64b1-4ba8-b80f-345efe0b538d tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:41:46.117640 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-aeddefac-64b1-4ba8-b80f-345efe0b538d tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167" status: 200 len: 1278 microversion: 2.1 time: 0.153351 Sep 30 19:41:46.118193 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 538/1116] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:41:45 2022] GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167 => generated 1278 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:41:47.141452 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-ca1e83a8-c531-4185-897c-1aabfafc9aa3 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:41:47.142088 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-ca1e83a8-c531-4185-897c-1aabfafc9aa3 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e9c06b75-e09a-4590-a6df-e8903fce4167] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:41:47.148937 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ca1e83a8-c531-4185-897c-1aabfafc9aa3 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:47.149415 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ca1e83a8-c531-4185-897c-1aabfafc9aa3 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:47.149847 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ca1e83a8-c531-4185-897c-1aabfafc9aa3 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:47.150526 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ca1e83a8-c531-4185-897c-1aabfafc9aa3 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:47.150974 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ca1e83a8-c531-4185-897c-1aabfafc9aa3 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:47.151395 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ca1e83a8-c531-4185-897c-1aabfafc9aa3 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:47.280685 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-ca1e83a8-c531-4185-897c-1aabfafc9aa3 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:41:47.288612 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-ca1e83a8-c531-4185-897c-1aabfafc9aa3 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167" status: 200 len: 1278 microversion: 2.1 time: 0.150907 Sep 30 19:41:47.289167 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 579/1117] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:41:47 2022] GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167 => generated 1278 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:41:48.311981 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-c5fc9c61-7f34-4269-a32b-9235e9db60b0 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:41:48.313688 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-c5fc9c61-7f34-4269-a32b-9235e9db60b0 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e9c06b75-e09a-4590-a6df-e8903fce4167] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:41:48.319951 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=2 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:41:48.322408 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c5fc9c61-7f34-4269-a32b-9235e9db60b0 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:48.323413 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c5fc9c61-7f34-4269-a32b-9235e9db60b0 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:48.324085 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c5fc9c61-7f34-4269-a32b-9235e9db60b0 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:48.325210 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c5fc9c61-7f34-4269-a32b-9235e9db60b0 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:48.325969 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c5fc9c61-7f34-4269-a32b-9235e9db60b0 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:48.326666 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c5fc9c61-7f34-4269-a32b-9235e9db60b0 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:48.471299 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-c5fc9c61-7f34-4269-a32b-9235e9db60b0 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:41:48.487272 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-c5fc9c61-7f34-4269-a32b-9235e9db60b0 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167" status: 200 len: 1278 microversion: 2.1 time: 0.179833 Sep 30 19:41:48.487863 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 539/1118] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:41:48 2022] GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167 => generated 1278 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:41:49.511007 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-685cc2bc-3517-479b-a950-f86bfc82cb4d tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:41:49.511927 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-685cc2bc-3517-479b-a950-f86bfc82cb4d tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e9c06b75-e09a-4590-a6df-e8903fce4167] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:41:49.518718 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell0:SELECT=2 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:41:49.518718 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell0:SELECT=6 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:41:49.521361 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-685cc2bc-3517-479b-a950-f86bfc82cb4d tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:49.522582 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-685cc2bc-3517-479b-a950-f86bfc82cb4d tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:49.523020 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-685cc2bc-3517-479b-a950-f86bfc82cb4d tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:49.523710 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-685cc2bc-3517-479b-a950-f86bfc82cb4d tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:49.524168 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-685cc2bc-3517-479b-a950-f86bfc82cb4d tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:49.524626 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-685cc2bc-3517-479b-a950-f86bfc82cb4d tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:49.658887 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-685cc2bc-3517-479b-a950-f86bfc82cb4d tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:41:49.666863 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-685cc2bc-3517-479b-a950-f86bfc82cb4d tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167" status: 200 len: 1278 microversion: 2.1 time: 0.160689 Sep 30 19:41:49.667422 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 580/1119] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:41:49 2022] GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167 => generated 1278 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:41:50.689637 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-7d47175c-a618-46d4-a549-50b65a99d3bb tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:41:50.690248 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-7d47175c-a618-46d4-a549-50b65a99d3bb tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e9c06b75-e09a-4590-a6df-e8903fce4167] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:41:50.698499 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7d47175c-a618-46d4-a549-50b65a99d3bb tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:50.699246 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7d47175c-a618-46d4-a549-50b65a99d3bb tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:50.699917 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7d47175c-a618-46d4-a549-50b65a99d3bb tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:50.700860 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7d47175c-a618-46d4-a549-50b65a99d3bb tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:50.701319 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7d47175c-a618-46d4-a549-50b65a99d3bb tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:50.701765 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7d47175c-a618-46d4-a549-50b65a99d3bb tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:50.841464 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-7d47175c-a618-46d4-a549-50b65a99d3bb tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:41:50.845208 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:41:50.851149 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-7d47175c-a618-46d4-a549-50b65a99d3bb tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167" status: 200 len: 1266 microversion: 2.1 time: 0.165448 Sep 30 19:41:50.851716 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 540/1120] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:41:50 2022] GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:41:51.874338 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-b373ff93-e050-45a5-b59b-cab0e789854e tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:41:51.874945 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-b373ff93-e050-45a5-b59b-cab0e789854e tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e9c06b75-e09a-4590-a6df-e8903fce4167] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:41:51.881742 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b373ff93-e050-45a5-b59b-cab0e789854e tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:51.882220 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b373ff93-e050-45a5-b59b-cab0e789854e tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:51.882656 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b373ff93-e050-45a5-b59b-cab0e789854e tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:51.883349 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b373ff93-e050-45a5-b59b-cab0e789854e tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:51.883802 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b373ff93-e050-45a5-b59b-cab0e789854e tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:51.884237 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b373ff93-e050-45a5-b59b-cab0e789854e tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:52.015237 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-b373ff93-e050-45a5-b59b-cab0e789854e tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:41:52.023706 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-b373ff93-e050-45a5-b59b-cab0e789854e tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167" status: 200 len: 1266 microversion: 2.1 time: 0.153065 Sep 30 19:41:52.024454 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 581/1121] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:41:51 2022] GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:41:53.046113 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-dca20069-a071-432e-9f51-22b84094b085 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:41:53.046720 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-dca20069-a071-432e-9f51-22b84094b085 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e9c06b75-e09a-4590-a6df-e8903fce4167] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:41:53.054892 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-dca20069-a071-432e-9f51-22b84094b085 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:53.055370 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-dca20069-a071-432e-9f51-22b84094b085 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:53.055802 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-dca20069-a071-432e-9f51-22b84094b085 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:53.056517 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-dca20069-a071-432e-9f51-22b84094b085 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:53.056968 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-dca20069-a071-432e-9f51-22b84094b085 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:53.057392 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-dca20069-a071-432e-9f51-22b84094b085 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:53.187027 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-dca20069-a071-432e-9f51-22b84094b085 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:41:53.195096 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-dca20069-a071-432e-9f51-22b84094b085 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167" status: 200 len: 1266 microversion: 2.1 time: 0.153067 Sep 30 19:41:53.195659 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 541/1122] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:41:53 2022] GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:41:54.218287 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-26e3bf7f-9797-43e1-ae52-badedbf238d8 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:41:54.218896 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-26e3bf7f-9797-43e1-ae52-badedbf238d8 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e9c06b75-e09a-4590-a6df-e8903fce4167] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:41:54.220789 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:41:54.226674 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-26e3bf7f-9797-43e1-ae52-badedbf238d8 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:54.227167 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-26e3bf7f-9797-43e1-ae52-badedbf238d8 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:54.227613 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-26e3bf7f-9797-43e1-ae52-badedbf238d8 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:54.228345 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-26e3bf7f-9797-43e1-ae52-badedbf238d8 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:54.228836 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-26e3bf7f-9797-43e1-ae52-badedbf238d8 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:54.229330 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-26e3bf7f-9797-43e1-ae52-badedbf238d8 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:54.234247 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell1:SELECT=83 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:41:54.360750 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-26e3bf7f-9797-43e1-ae52-badedbf238d8 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:41:54.368447 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-26e3bf7f-9797-43e1-ae52-badedbf238d8 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167" status: 200 len: 1266 microversion: 2.1 time: 0.154151 Sep 30 19:41:54.369022 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 582/1123] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:41:54 2022] GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:41:55.390749 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-8f1d72fd-2bf6-4bc8-833e-905d71734233 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:41:55.391373 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-8f1d72fd-2bf6-4bc8-833e-905d71734233 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e9c06b75-e09a-4590-a6df-e8903fce4167] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:41:55.393798 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:41:55.398724 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8f1d72fd-2bf6-4bc8-833e-905d71734233 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:55.399355 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8f1d72fd-2bf6-4bc8-833e-905d71734233 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:55.399896 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8f1d72fd-2bf6-4bc8-833e-905d71734233 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:55.400794 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8f1d72fd-2bf6-4bc8-833e-905d71734233 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:55.401385 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8f1d72fd-2bf6-4bc8-833e-905d71734233 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:55.401887 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8f1d72fd-2bf6-4bc8-833e-905d71734233 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:55.533466 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-8f1d72fd-2bf6-4bc8-833e-905d71734233 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:41:55.542167 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-8f1d72fd-2bf6-4bc8-833e-905d71734233 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167" status: 200 len: 1266 microversion: 2.1 time: 0.155257 Sep 30 19:41:55.542735 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 542/1124] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:41:55 2022] GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:41:56.566841 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-5852177c-bad1-47d1-bbc7-106ae74ba6bd tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:41:56.567452 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-5852177c-bad1-47d1-bbc7-106ae74ba6bd tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e9c06b75-e09a-4590-a6df-e8903fce4167] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:41:56.573999 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5852177c-bad1-47d1-bbc7-106ae74ba6bd tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:56.574481 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5852177c-bad1-47d1-bbc7-106ae74ba6bd tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:56.574917 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5852177c-bad1-47d1-bbc7-106ae74ba6bd tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:56.575612 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5852177c-bad1-47d1-bbc7-106ae74ba6bd tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:56.576064 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5852177c-bad1-47d1-bbc7-106ae74ba6bd tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:56.576521 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5852177c-bad1-47d1-bbc7-106ae74ba6bd tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:56.704867 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-5852177c-bad1-47d1-bbc7-106ae74ba6bd tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:41:56.713060 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-5852177c-bad1-47d1-bbc7-106ae74ba6bd tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167" status: 200 len: 1266 microversion: 2.1 time: 0.150127 Sep 30 19:41:56.713628 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 583/1125] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:41:56 2022] GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:41:57.736058 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-bbc4342d-a132-4e25-b966-7a92e049cea1 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:41:57.736705 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-bbc4342d-a132-4e25-b966-7a92e049cea1 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e9c06b75-e09a-4590-a6df-e8903fce4167] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:41:57.743851 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bbc4342d-a132-4e25-b966-7a92e049cea1 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:57.744337 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bbc4342d-a132-4e25-b966-7a92e049cea1 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:57.744830 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bbc4342d-a132-4e25-b966-7a92e049cea1 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:57.745535 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bbc4342d-a132-4e25-b966-7a92e049cea1 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:57.745995 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bbc4342d-a132-4e25-b966-7a92e049cea1 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:57.746427 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bbc4342d-a132-4e25-b966-7a92e049cea1 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:57.876677 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-bbc4342d-a132-4e25-b966-7a92e049cea1 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:41:57.884330 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-bbc4342d-a132-4e25-b966-7a92e049cea1 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167" status: 200 len: 1266 microversion: 2.1 time: 0.152088 Sep 30 19:41:57.884910 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 543/1126] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:41:57 2022] GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:41:58.906664 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-0005660c-109c-414a-91ce-a3544a887564 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:41:58.907266 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-0005660c-109c-414a-91ce-a3544a887564 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e9c06b75-e09a-4590-a6df-e8903fce4167] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:41:58.913928 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0005660c-109c-414a-91ce-a3544a887564 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:58.914409 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0005660c-109c-414a-91ce-a3544a887564 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:58.914842 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0005660c-109c-414a-91ce-a3544a887564 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:58.915553 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0005660c-109c-414a-91ce-a3544a887564 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:41:58.916000 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0005660c-109c-414a-91ce-a3544a887564 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:41:58.916443 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0005660c-109c-414a-91ce-a3544a887564 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:41:59.048557 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-0005660c-109c-414a-91ce-a3544a887564 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:41:59.056723 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-0005660c-109c-414a-91ce-a3544a887564 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167" status: 200 len: 1266 microversion: 2.1 time: 0.153864 Sep 30 19:41:59.057283 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 584/1127] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:41:58 2022] GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:42:00.080234 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-510b36a7-fbe8-472b-938b-0934643968ce tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:42:00.080977 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-510b36a7-fbe8-472b-938b-0934643968ce tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e9c06b75-e09a-4590-a6df-e8903fce4167] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:42:00.088147 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-510b36a7-fbe8-472b-938b-0934643968ce tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:00.088668 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-510b36a7-fbe8-472b-938b-0934643968ce tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:00.089182 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-510b36a7-fbe8-472b-938b-0934643968ce tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:00.089956 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-510b36a7-fbe8-472b-938b-0934643968ce tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:00.090506 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-510b36a7-fbe8-472b-938b-0934643968ce tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:00.090928 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-510b36a7-fbe8-472b-938b-0934643968ce tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:00.236988 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-510b36a7-fbe8-472b-938b-0934643968ce tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:42:00.245217 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-510b36a7-fbe8-472b-938b-0934643968ce tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167" status: 200 len: 1266 microversion: 2.1 time: 0.168787 Sep 30 19:42:00.245837 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 544/1128] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:42:00 2022] GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:42:01.268520 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-dd0e3b8d-4d3e-4399-9c58-36d8da6e259b tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:42:01.269136 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-dd0e3b8d-4d3e-4399-9c58-36d8da6e259b tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e9c06b75-e09a-4590-a6df-e8903fce4167] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:42:01.276118 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-dd0e3b8d-4d3e-4399-9c58-36d8da6e259b tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:01.276635 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-dd0e3b8d-4d3e-4399-9c58-36d8da6e259b tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:01.277072 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-dd0e3b8d-4d3e-4399-9c58-36d8da6e259b tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:01.277782 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-dd0e3b8d-4d3e-4399-9c58-36d8da6e259b tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:01.278220 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-dd0e3b8d-4d3e-4399-9c58-36d8da6e259b tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:01.278648 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-dd0e3b8d-4d3e-4399-9c58-36d8da6e259b tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:01.430131 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-dd0e3b8d-4d3e-4399-9c58-36d8da6e259b tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:42:01.438273 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-dd0e3b8d-4d3e-4399-9c58-36d8da6e259b tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167" status: 200 len: 1266 microversion: 2.1 time: 0.173429 Sep 30 19:42:01.438843 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 585/1129] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:42:01 2022] GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:42:02.461026 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-38dc8a8c-12e2-4194-b6e2-c3c6b14c40d3 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:42:02.461641 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-38dc8a8c-12e2-4194-b6e2-c3c6b14c40d3 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e9c06b75-e09a-4590-a6df-e8903fce4167] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:42:02.468596 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-38dc8a8c-12e2-4194-b6e2-c3c6b14c40d3 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:02.468955 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-38dc8a8c-12e2-4194-b6e2-c3c6b14c40d3 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:02.469499 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-38dc8a8c-12e2-4194-b6e2-c3c6b14c40d3 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:02.470264 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-38dc8a8c-12e2-4194-b6e2-c3c6b14c40d3 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:02.470793 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-38dc8a8c-12e2-4194-b6e2-c3c6b14c40d3 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:02.471242 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-38dc8a8c-12e2-4194-b6e2-c3c6b14c40d3 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:02.667393 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-38dc8a8c-12e2-4194-b6e2-c3c6b14c40d3 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:42:02.675550 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-38dc8a8c-12e2-4194-b6e2-c3c6b14c40d3 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167" status: 200 len: 1266 microversion: 2.1 time: 0.218264 Sep 30 19:42:02.676324 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 545/1130] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:42:02 2022] GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167 => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:42:03.697896 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-9fbd5ea6-651f-409c-9c91-3a84e077f4ac tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:42:03.698507 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-9fbd5ea6-651f-409c-9c91-3a84e077f4ac tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e9c06b75-e09a-4590-a6df-e8903fce4167] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:42:03.704913 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9fbd5ea6-651f-409c-9c91-3a84e077f4ac tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:03.705389 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9fbd5ea6-651f-409c-9c91-3a84e077f4ac tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:03.705824 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9fbd5ea6-651f-409c-9c91-3a84e077f4ac tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:03.706509 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9fbd5ea6-651f-409c-9c91-3a84e077f4ac tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:03.706958 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9fbd5ea6-651f-409c-9c91-3a84e077f4ac tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:03.707378 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9fbd5ea6-651f-409c-9c91-3a84e077f4ac tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:03.840928 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-9fbd5ea6-651f-409c-9c91-3a84e077f4ac tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:42:03.848837 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-9fbd5ea6-651f-409c-9c91-3a84e077f4ac tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167" status: 200 len: 1266 microversion: 2.1 time: 0.154740 Sep 30 19:42:03.849403 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 586/1131] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:42:03 2022] GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:42:04.871072 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-d24c0a4d-a5ab-44bb-b1b5-821c1dd6211b tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:42:04.871679 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-d24c0a4d-a5ab-44bb-b1b5-821c1dd6211b tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e9c06b75-e09a-4590-a6df-e8903fce4167] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:42:04.878010 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d24c0a4d-a5ab-44bb-b1b5-821c1dd6211b tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:04.878496 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d24c0a4d-a5ab-44bb-b1b5-821c1dd6211b tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:04.878927 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d24c0a4d-a5ab-44bb-b1b5-821c1dd6211b tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:04.879606 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d24c0a4d-a5ab-44bb-b1b5-821c1dd6211b tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:04.880056 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d24c0a4d-a5ab-44bb-b1b5-821c1dd6211b tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:04.880501 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d24c0a4d-a5ab-44bb-b1b5-821c1dd6211b tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:05.019306 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-d24c0a4d-a5ab-44bb-b1b5-821c1dd6211b tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:42:05.027472 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-d24c0a4d-a5ab-44bb-b1b5-821c1dd6211b tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167" status: 200 len: 1266 microversion: 2.1 time: 0.160354 Sep 30 19:42:05.028027 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 546/1132] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:42:04 2022] GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:42:06.050845 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-465e6c59-489a-4b5f-a2e4-bc20aefe97fa tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:42:06.052027 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-465e6c59-489a-4b5f-a2e4-bc20aefe97fa tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e9c06b75-e09a-4590-a6df-e8903fce4167] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:42:06.059846 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-465e6c59-489a-4b5f-a2e4-bc20aefe97fa tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:06.060573 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-465e6c59-489a-4b5f-a2e4-bc20aefe97fa tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:06.061172 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-465e6c59-489a-4b5f-a2e4-bc20aefe97fa tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:06.062065 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-465e6c59-489a-4b5f-a2e4-bc20aefe97fa tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:06.062520 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-465e6c59-489a-4b5f-a2e4-bc20aefe97fa tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:06.062943 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-465e6c59-489a-4b5f-a2e4-bc20aefe97fa tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:06.195282 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-465e6c59-489a-4b5f-a2e4-bc20aefe97fa tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:42:06.205059 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-465e6c59-489a-4b5f-a2e4-bc20aefe97fa tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167" status: 200 len: 1266 microversion: 2.1 time: 0.158000 Sep 30 19:42:06.205651 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 587/1133] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:42:06 2022] GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:42:07.227774 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-9adfaaac-8815-47d2-9867-9fbfa5f9ea8d tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:42:07.228404 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-9adfaaac-8815-47d2-9867-9fbfa5f9ea8d tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e9c06b75-e09a-4590-a6df-e8903fce4167] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:42:07.235653 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9adfaaac-8815-47d2-9867-9fbfa5f9ea8d tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:07.236148 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9adfaaac-8815-47d2-9867-9fbfa5f9ea8d tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:07.237048 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9adfaaac-8815-47d2-9867-9fbfa5f9ea8d tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:07.237756 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9adfaaac-8815-47d2-9867-9fbfa5f9ea8d tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:07.238220 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9adfaaac-8815-47d2-9867-9fbfa5f9ea8d tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:07.238848 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9adfaaac-8815-47d2-9867-9fbfa5f9ea8d tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:07.366706 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-9adfaaac-8815-47d2-9867-9fbfa5f9ea8d tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:42:07.374288 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-9adfaaac-8815-47d2-9867-9fbfa5f9ea8d tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167" status: 200 len: 1266 microversion: 2.1 time: 0.150425 Sep 30 19:42:07.374859 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 547/1134] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:42:07 2022] GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:42:08.397546 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-78aef63e-c709-4e2b-91b5-bc878504143e tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:42:08.398812 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-78aef63e-c709-4e2b-91b5-bc878504143e tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e9c06b75-e09a-4590-a6df-e8903fce4167] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:42:08.405933 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-78aef63e-c709-4e2b-91b5-bc878504143e tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:08.406491 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-78aef63e-c709-4e2b-91b5-bc878504143e tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:08.406998 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-78aef63e-c709-4e2b-91b5-bc878504143e tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:08.407770 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-78aef63e-c709-4e2b-91b5-bc878504143e tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:08.408400 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-78aef63e-c709-4e2b-91b5-bc878504143e tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:08.408887 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-78aef63e-c709-4e2b-91b5-bc878504143e tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:08.565306 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-78aef63e-c709-4e2b-91b5-bc878504143e tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:42:08.574068 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-78aef63e-c709-4e2b-91b5-bc878504143e tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167" status: 200 len: 1266 microversion: 2.1 time: 0.180377 Sep 30 19:42:08.574651 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 588/1135] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:42:08 2022] GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:42:08.934008 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-3d076ec3-bbe4-48ee-b516-46ecc507d462 req-0da7a642-6efe-48a9-81c3-9dbd99904381 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9c06b75-e09a-4590-a6df-e8903fce4167", "name": "network-vif-plugged", "status": "completed", "tag": "c4655abc-d99b-4462-80dd-d51207134ed3"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:42:08.945319 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-3d076ec3-bbe4-48ee-b516-46ecc507d462 req-0da7a642-6efe-48a9-81c3-9dbd99904381 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:08.945852 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-3d076ec3-bbe4-48ee-b516-46ecc507d462 req-0da7a642-6efe-48a9-81c3-9dbd99904381 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:08.946345 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-3d076ec3-bbe4-48ee-b516-46ecc507d462 req-0da7a642-6efe-48a9-81c3-9dbd99904381 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:08.958400 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-3d076ec3-bbe4-48ee-b516-46ecc507d462 req-0da7a642-6efe-48a9-81c3-9dbd99904381 service nova] Creating event network-vif-plugged:c4655abc-d99b-4462-80dd-d51207134ed3 for instance e9c06b75-e09a-4590-a6df-e8903fce4167 on hv-cinder-86001 Sep 30 19:42:08.963538 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-3d076ec3-bbe4-48ee-b516-46ecc507d462 req-0da7a642-6efe-48a9-81c3-9dbd99904381 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034238 Sep 30 19:42:08.964422 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 548/1136] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:42:09.602790 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-e247c58e-3b9b-4781-b454-38bd3ca310ea tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:42:09.603237 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-e247c58e-3b9b-4781-b454-38bd3ca310ea tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e9c06b75-e09a-4590-a6df-e8903fce4167] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:42:09.609746 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e247c58e-3b9b-4781-b454-38bd3ca310ea tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:09.610227 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e247c58e-3b9b-4781-b454-38bd3ca310ea tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:09.610660 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e247c58e-3b9b-4781-b454-38bd3ca310ea tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:09.611351 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e247c58e-3b9b-4781-b454-38bd3ca310ea tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:09.611802 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e247c58e-3b9b-4781-b454-38bd3ca310ea tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:09.612233 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e247c58e-3b9b-4781-b454-38bd3ca310ea tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:09.672954 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-8e3667e1-69cf-40b0-96a5-5b0b4734c9b6 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:42:09.673558 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-8e3667e1-69cf-40b0-96a5-5b0b4734c9b6 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] [instance: 8cf27336-b00a-4fc7-ab9e-e5c8116d41e4] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:42:09.679714 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8e3667e1-69cf-40b0-96a5-5b0b4734c9b6 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:09.680215 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8e3667e1-69cf-40b0-96a5-5b0b4734c9b6 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:09.680700 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8e3667e1-69cf-40b0-96a5-5b0b4734c9b6 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:09.681394 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8e3667e1-69cf-40b0-96a5-5b0b4734c9b6 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:09.682086 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8e3667e1-69cf-40b0-96a5-5b0b4734c9b6 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:09.682727 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8e3667e1-69cf-40b0-96a5-5b0b4734c9b6 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:09.763587 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-e247c58e-3b9b-4781-b454-38bd3ca310ea tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:42:09.772008 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-e247c58e-3b9b-4781-b454-38bd3ca310ea tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167" status: 200 len: 1266 microversion: 2.1 time: 0.173917 Sep 30 19:42:09.772861 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 589/1137] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:42:09 2022] GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:42:09.776247 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.objects.instance [None req-8e3667e1-69cf-40b0-96a5-5b0b4734c9b6 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lazy-loading 'services' on Instance uuid 8cf27336-b00a-4fc7-ab9e-e5c8116d41e4 {{(pid=120648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 30 19:42:09.851608 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-8e3667e1-69cf-40b0-96a5-5b0b4734c9b6 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8cf27336-b00a-4fc7-ab9e-e5c8116d41e4/os-volume_attachments/08695ed7-b573-4303-b517-6f82ea2141f0" status: 202 len: 0 microversion: 2.1 time: 0.182658 Sep 30 19:42:09.852203 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 549/1138] 10.222.0.17 () {58 vars in 1416 bytes} [Fri Sep 30 19:42:09 2022] DELETE /compute/v2.1/servers/8cf27336-b00a-4fc7-ab9e-e5c8116d41e4/os-volume_attachments/08695ed7-b573-4303-b517-6f82ea2141f0 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 30 19:42:10.795793 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-8ccbd387-0bfb-442e-9e02-9197d2200577 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:42:10.796423 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-8ccbd387-0bfb-442e-9e02-9197d2200577 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e9c06b75-e09a-4590-a6df-e8903fce4167] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:42:10.803103 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8ccbd387-0bfb-442e-9e02-9197d2200577 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:10.803757 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8ccbd387-0bfb-442e-9e02-9197d2200577 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:10.804201 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8ccbd387-0bfb-442e-9e02-9197d2200577 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:10.805688 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8ccbd387-0bfb-442e-9e02-9197d2200577 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:10.806194 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8ccbd387-0bfb-442e-9e02-9197d2200577 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:10.806763 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8ccbd387-0bfb-442e-9e02-9197d2200577 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:10.941715 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-8ccbd387-0bfb-442e-9e02-9197d2200577 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:42:10.950769 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-8ccbd387-0bfb-442e-9e02-9197d2200577 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167" status: 200 len: 1266 microversion: 2.1 time: 0.159249 Sep 30 19:42:10.951333 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 590/1139] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:42:10 2022] GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:42:11.977512 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-504c1d6a-d2fe-4e54-bc8c-28b7aa0d1a72 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:42:11.978307 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-504c1d6a-d2fe-4e54-bc8c-28b7aa0d1a72 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e9c06b75-e09a-4590-a6df-e8903fce4167] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:42:11.985527 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-504c1d6a-d2fe-4e54-bc8c-28b7aa0d1a72 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:11.986022 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-504c1d6a-d2fe-4e54-bc8c-28b7aa0d1a72 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:11.986495 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-504c1d6a-d2fe-4e54-bc8c-28b7aa0d1a72 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:11.987394 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-504c1d6a-d2fe-4e54-bc8c-28b7aa0d1a72 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:11.987856 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-504c1d6a-d2fe-4e54-bc8c-28b7aa0d1a72 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:11.988479 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-504c1d6a-d2fe-4e54-bc8c-28b7aa0d1a72 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:12.038483 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-ba1753e3-ca52-4db9-a5a0-67746027e042 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:42:12.039576 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-ba1753e3-ca52-4db9-a5a0-67746027e042 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] [instance: 8cf27336-b00a-4fc7-ab9e-e5c8116d41e4] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:42:12.045984 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ba1753e3-ca52-4db9-a5a0-67746027e042 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:12.046466 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ba1753e3-ca52-4db9-a5a0-67746027e042 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:12.046909 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ba1753e3-ca52-4db9-a5a0-67746027e042 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:12.047619 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ba1753e3-ca52-4db9-a5a0-67746027e042 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:12.048052 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ba1753e3-ca52-4db9-a5a0-67746027e042 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:12.048507 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ba1753e3-ca52-4db9-a5a0-67746027e042 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:12.075849 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-ba1753e3-ca52-4db9-a5a0-67746027e042 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] [instance: 8cf27336-b00a-4fc7-ab9e-e5c8116d41e4] Going to try to terminate instance {{(pid=120649) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 30 19:42:12.128459 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-504c1d6a-d2fe-4e54-bc8c-28b7aa0d1a72 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:42:12.136228 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-504c1d6a-d2fe-4e54-bc8c-28b7aa0d1a72 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167" status: 200 len: 1454 microversion: 2.1 time: 0.164709 Sep 30 19:42:12.136838 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 550/1140] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:42:11 2022] GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167 => generated 1454 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:42:12.153812 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-ba1753e3-ca52-4db9-a5a0-67746027e042 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8cf27336-b00a-4fc7-ab9e-e5c8116d41e4" status: 204 len: 0 microversion: 2.1 time: 0.119107 Sep 30 19:42:12.154578 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 591/1141] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 30 19:42:12 2022] DELETE /compute/v2.1/servers/8cf27336-b00a-4fc7-ab9e-e5c8116d41e4 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 30 19:42:12.160535 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-000877d7-9b35-49e7-a6b8-64f85392745a tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:42:12.161489 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-000877d7-9b35-49e7-a6b8-64f85392745a tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e9c06b75-e09a-4590-a6df-e8903fce4167] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:42:12.164715 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-4db90c69-e3e1-4ecb-bf3e-967ce9450255 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:42:12.165504 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-4db90c69-e3e1-4ecb-bf3e-967ce9450255 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] [instance: 8cf27336-b00a-4fc7-ab9e-e5c8116d41e4] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:42:12.168075 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-000877d7-9b35-49e7-a6b8-64f85392745a tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:12.168670 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-000877d7-9b35-49e7-a6b8-64f85392745a tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:12.169165 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-000877d7-9b35-49e7-a6b8-64f85392745a tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:12.169924 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-000877d7-9b35-49e7-a6b8-64f85392745a tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:12.170589 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-000877d7-9b35-49e7-a6b8-64f85392745a tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:12.171095 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-000877d7-9b35-49e7-a6b8-64f85392745a tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:12.171421 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4db90c69-e3e1-4ecb-bf3e-967ce9450255 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:12.171904 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4db90c69-e3e1-4ecb-bf3e-967ce9450255 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:12.172410 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4db90c69-e3e1-4ecb-bf3e-967ce9450255 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:12.173064 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4db90c69-e3e1-4ecb-bf3e-967ce9450255 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:12.173519 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4db90c69-e3e1-4ecb-bf3e-967ce9450255 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:12.173948 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4db90c69-e3e1-4ecb-bf3e-967ce9450255 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:12.306107 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-000877d7-9b35-49e7-a6b8-64f85392745a tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:42:12.308694 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-4db90c69-e3e1-4ecb-bf3e-967ce9450255 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b46acc6b57473fa4cab2e37b761748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb45af355274456bc3759ebb76f6b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:42:12.314313 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-000877d7-9b35-49e7-a6b8-64f85392745a tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167" status: 200 len: 1454 microversion: 2.1 time: 0.159555 Sep 30 19:42:12.315117 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 551/1142] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:42:12 2022] GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167 => generated 1454 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:42:12.316675 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-4db90c69-e3e1-4ecb-bf3e-967ce9450255 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] 10.222.0.17 "GET /compute/v2.1/servers/8cf27336-b00a-4fc7-ab9e-e5c8116d41e4" status: 200 len: 1515 microversion: 2.1 time: 0.157299 Sep 30 19:42:12.320534 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 592/1143] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:42:12 2022] GET /compute/v2.1/servers/8cf27336-b00a-4fc7-ab9e-e5c8116d41e4 => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:42:13.339145 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-9845f667-150c-43e7-a4a7-1aeb695d5b44 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:42:13.339762 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-9845f667-150c-43e7-a4a7-1aeb695d5b44 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] [instance: 8cf27336-b00a-4fc7-ab9e-e5c8116d41e4] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:42:13.346163 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9845f667-150c-43e7-a4a7-1aeb695d5b44 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:13.346648 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9845f667-150c-43e7-a4a7-1aeb695d5b44 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:13.347086 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9845f667-150c-43e7-a4a7-1aeb695d5b44 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:13.347778 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9845f667-150c-43e7-a4a7-1aeb695d5b44 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:13.348235 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9845f667-150c-43e7-a4a7-1aeb695d5b44 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:13.348684 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9845f667-150c-43e7-a4a7-1aeb695d5b44 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:13.605860 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-9845f667-150c-43e7-a4a7-1aeb695d5b44 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b46acc6b57473fa4cab2e37b761748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb45af355274456bc3759ebb76f6b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:42:13.613521 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-9845f667-150c-43e7-a4a7-1aeb695d5b44 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] 10.222.0.17 "GET /compute/v2.1/servers/8cf27336-b00a-4fc7-ab9e-e5c8116d41e4" status: 200 len: 1515 microversion: 2.1 time: 0.278289 Sep 30 19:42:13.614091 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 552/1144] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:42:13 2022] GET /compute/v2.1/servers/8cf27336-b00a-4fc7-ab9e-e5c8116d41e4 => generated 1515 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:42:14.090648 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [req-d95a8761-2cbe-4fc6-b7a4-3ee64820da40 req-8d832b3a-6ab0-419d-a4f8-3f78336642c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9c06b75-e09a-4590-a6df-e8903fce4167", "tag": "c4655abc-d99b-4462-80dd-d51207134ed3"}]} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:42:14.100196 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-d95a8761-2cbe-4fc6-b7a4-3ee64820da40 req-8d832b3a-6ab0-419d-a4f8-3f78336642c0 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:14.100700 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-d95a8761-2cbe-4fc6-b7a4-3ee64820da40 req-8d832b3a-6ab0-419d-a4f8-3f78336642c0 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:14.101128 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-d95a8761-2cbe-4fc6-b7a4-3ee64820da40 req-8d832b3a-6ab0-419d-a4f8-3f78336642c0 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:14.112888 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.compute.server_external_events [req-d95a8761-2cbe-4fc6-b7a4-3ee64820da40 req-8d832b3a-6ab0-419d-a4f8-3f78336642c0 service nova] Creating event network-changed:c4655abc-d99b-4462-80dd-d51207134ed3 for instance e9c06b75-e09a-4590-a6df-e8903fce4167 on hv-cinder-86001 Sep 30 19:42:14.118264 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [req-d95a8761-2cbe-4fc6-b7a4-3ee64820da40 req-8d832b3a-6ab0-419d-a4f8-3f78336642c0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152122 Sep 30 19:42:14.118865 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 593/1145] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:42:14.637115 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-eebd60a5-b63d-4f11-8a20-88ebe9b73e82 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:42:14.637805 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-eebd60a5-b63d-4f11-8a20-88ebe9b73e82 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] [instance: 8cf27336-b00a-4fc7-ab9e-e5c8116d41e4] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:42:14.644269 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-eebd60a5-b63d-4f11-8a20-88ebe9b73e82 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:14.644880 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-eebd60a5-b63d-4f11-8a20-88ebe9b73e82 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:14.645382 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-eebd60a5-b63d-4f11-8a20-88ebe9b73e82 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:14.646394 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-eebd60a5-b63d-4f11-8a20-88ebe9b73e82 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:14.646913 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-eebd60a5-b63d-4f11-8a20-88ebe9b73e82 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:14.647599 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-eebd60a5-b63d-4f11-8a20-88ebe9b73e82 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:14.792116 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-eebd60a5-b63d-4f11-8a20-88ebe9b73e82 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b46acc6b57473fa4cab2e37b761748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb45af355274456bc3759ebb76f6b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:42:14.799987 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-eebd60a5-b63d-4f11-8a20-88ebe9b73e82 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] 10.222.0.17 "GET /compute/v2.1/servers/8cf27336-b00a-4fc7-ab9e-e5c8116d41e4" status: 200 len: 1515 microversion: 2.1 time: 0.167182 Sep 30 19:42:14.808895 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 553/1146] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:42:14 2022] GET /compute/v2.1/servers/8cf27336-b00a-4fc7-ab9e-e5c8116d41e4 => generated 1515 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:42:15.823907 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-6ab61b12-d2dc-472c-aedd-a620f39d80db tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:42:15.824542 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-6ab61b12-d2dc-472c-aedd-a620f39d80db tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] [instance: 8cf27336-b00a-4fc7-ab9e-e5c8116d41e4] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:42:15.830641 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6ab61b12-d2dc-472c-aedd-a620f39d80db tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:15.831126 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6ab61b12-d2dc-472c-aedd-a620f39d80db tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:15.831570 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6ab61b12-d2dc-472c-aedd-a620f39d80db tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:15.832259 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6ab61b12-d2dc-472c-aedd-a620f39d80db tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:15.832739 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6ab61b12-d2dc-472c-aedd-a620f39d80db tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:15.833166 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6ab61b12-d2dc-472c-aedd-a620f39d80db tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:15.867791 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6ab61b12-d2dc-472c-aedd-a620f39d80db tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:15.868448 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6ab61b12-d2dc-472c-aedd-a620f39d80db tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:15.868892 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6ab61b12-d2dc-472c-aedd-a620f39d80db tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:15.869345 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.objects.instance [None req-6ab61b12-d2dc-472c-aedd-a620f39d80db tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lazy-loading 'fault' on Instance uuid 8cf27336-b00a-4fc7-ab9e-e5c8116d41e4 {{(pid=120649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 30 19:42:15.912400 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-6ab61b12-d2dc-472c-aedd-a620f39d80db tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b46acc6b57473fa4cab2e37b761748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb45af355274456bc3759ebb76f6b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:42:15.921309 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-6ab61b12-d2dc-472c-aedd-a620f39d80db tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] 10.222.0.17 "GET /compute/v2.1/servers/8cf27336-b00a-4fc7-ab9e-e5c8116d41e4" status: 200 len: 1309 microversion: 2.1 time: 0.102159 Sep 30 19:42:15.921961 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 594/1147] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:42:15 2022] GET /compute/v2.1/servers/8cf27336-b00a-4fc7-ab9e-e5c8116d41e4 => generated 1309 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:42:16.132465 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-4d382d5a-467b-4f7d-94cb-c36d55233464 req-c30ebcef-d36e-46c3-9317-586a1e967e3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cf27336-b00a-4fc7-ab9e-e5c8116d41e4", "name": "network-vif-deleted", "tag": "e8570c00-a37a-4350-8728-48685d65618a"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:42:16.142417 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-4d382d5a-467b-4f7d-94cb-c36d55233464 req-c30ebcef-d36e-46c3-9317-586a1e967e3d service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:16.142897 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-4d382d5a-467b-4f7d-94cb-c36d55233464 req-c30ebcef-d36e-46c3-9317-586a1e967e3d service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:16.143331 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-4d382d5a-467b-4f7d-94cb-c36d55233464 req-c30ebcef-d36e-46c3-9317-586a1e967e3d service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:16.154391 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-4d382d5a-467b-4f7d-94cb-c36d55233464 req-c30ebcef-d36e-46c3-9317-586a1e967e3d service nova] Creating event network-vif-deleted:e8570c00-a37a-4350-8728-48685d65618a for instance 8cf27336-b00a-4fc7-ab9e-e5c8116d41e4 on hv-cinder-86001 Sep 30 19:42:16.159878 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-4d382d5a-467b-4f7d-94cb-c36d55233464 req-c30ebcef-d36e-46c3-9317-586a1e967e3d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031065 Sep 30 19:42:16.160501 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 554/1148] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:42:16.946077 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-c2118b85-52d9-4da9-8209-e4b606501c45 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:42:16.946687 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-c2118b85-52d9-4da9-8209-e4b606501c45 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] [instance: 8cf27336-b00a-4fc7-ab9e-e5c8116d41e4] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:42:16.953049 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c2118b85-52d9-4da9-8209-e4b606501c45 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:16.953535 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c2118b85-52d9-4da9-8209-e4b606501c45 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:16.953967 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c2118b85-52d9-4da9-8209-e4b606501c45 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:16.954649 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c2118b85-52d9-4da9-8209-e4b606501c45 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:16.955098 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c2118b85-52d9-4da9-8209-e4b606501c45 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:16.955520 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c2118b85-52d9-4da9-8209-e4b606501c45 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:16.969351 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.wsgi [None req-c2118b85-52d9-4da9-8209-e4b606501c45 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] HTTP exception thrown: Instance 8cf27336-b00a-4fc7-ab9e-e5c8116d41e4 could not be found. Sep 30 19:42:16.971159 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-c2118b85-52d9-4da9-8209-e4b606501c45 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Request method failure captured: Sep 30 19:42:16.971159 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: request: GET /compute/v2.1/servers/8cf27336-b00a-4fc7-ab9e-e5c8116d41e4 HTTP/1.1 Sep 30 19:42:16.971159 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Accept: application/json Sep 30 19:42:16.971159 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Accept-Encoding: identity Sep 30 19:42:16.971159 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Connection: close Sep 30 19:42:16.971159 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Content-Length: 0 Sep 30 19:42:16.971159 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Content-Type: application/json Sep 30 19:42:16.971159 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Host: 10.222.0.17 Sep 30 19:42:16.971159 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Openstack-System-Scope: None Sep 30 19:42:16.971159 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: User-Agent: python-urllib3/1.26.12 Sep 30 19:42:16.971159 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Auth-Token: gAAAAABjN0Y-hGt_GD3stRKMr_vK4THzhA8g-1_ZUYy6whZqm5ymIsh6jYnUOSCbZUO9w7k8WOep0MIDucIxF2uhEso5ikNMAJbUCD6UFySYjn2_kyNsF8k0tucqu0vnwSu7voblG5j7X4qypH1z_aDqw2z6r38cP9NRhWljOhPGNWae4ChtNls Sep 30 19:42:16.971159 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Domain-Id: None Sep 30 19:42:16.971159 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Domain-Name: None Sep 30 19:42:16.971159 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Identity-Status: Confirmed Sep 30 19:42:16.971159 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Is-Admin-Project: True Sep 30 19:42:16.971159 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Domain-Id: default Sep 30 19:42:16.971159 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Domain-Name: Default Sep 30 19:42:16.971159 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Id: 9fb45af355274456bc3759ebb76f6b72 Sep 30 19:42:16.971159 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Name: tempest-VolumesSnapshotTestJSON-278290515 Sep 30 19:42:16.971159 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Role: member,reader Sep 30 19:42:16.971159 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Roles: member,reader Sep 30 19:42:16.972761 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9fb45af355274456bc3759ebb76f6b72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9fb45af355274456bc3759ebb76f6b72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9fb45af355274456bc3759ebb76f6b72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9fb45af355274456bc3759ebb76f6b72"}]}] Sep 30 19:42:16.972761 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant: tempest-VolumesSnapshotTestJSON-278290515 Sep 30 19:42:16.972761 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant-Id: 9fb45af355274456bc3759ebb76f6b72 Sep 30 19:42:16.972761 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-278290515 Sep 30 19:42:16.972761 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User: tempest-VolumesSnapshotTestJSON-278290515-project Sep 30 19:42:16.972761 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Domain-Id: default Sep 30 19:42:16.972761 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Domain-Name: Default Sep 30 19:42:16.972761 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Id: c5b46acc6b57473fa4cab2e37b761748 Sep 30 19:42:16.972761 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Name: tempest-VolumesSnapshotTestJSON-278290515-project Sep 30 19:42:16.972761 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: method: > Sep 30 19:42:16.972761 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: exception: Instance 8cf27336-b00a-4fc7-ab9e-e5c8116d41e4 could not be found. Sep 30 19:42:16.972761 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: action_args: {'id': '8cf27336-b00a-4fc7-ab9e-e5c8116d41e4'} Sep 30 19:42:16.973696 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:42:16.973696 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:42:16.973696 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 30 19:42:16.973696 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 30 19:42:16.973696 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 30 19:42:16.973696 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 30 19:42:16.973696 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 30 19:42:16.973696 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 30 19:42:16.973696 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 30 19:42:16.973696 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 30 19:42:16.973696 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cf27336-b00a-4fc7-ab9e-e5c8116d41e4 could not be found. Sep 30 19:42:16.973696 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:42:16.973696 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:42:16.973696 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:42:16.973696 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:42:16.973696 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:42:16.973696 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:42:16.973696 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:42:16.973696 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:42:16.973696 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:42:16.976027 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:42:16.976027 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 30 19:42:16.976027 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 30 19:42:16.976027 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 30 19:42:16.976027 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 30 19:42:16.976027 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 30 19:42:16.976027 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 30 19:42:16.976027 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cf27336-b00a-4fc7-ab9e-e5c8116d41e4 could not be found. Sep 30 19:42:16.976027 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:42:16.976027 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:42:16.976027 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:42:16.976027 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:42:16.976027 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:42:16.976027 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:42:16.976027 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:42:16.976027 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:42:16.976027 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cf27336-b00a-4fc7-ab9e-e5c8116d41e4 could not be found. Sep 30 19:42:16.976027 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:42:16.977591 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-c2118b85-52d9-4da9-8209-e4b606501c45 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Returning 404 to user: Instance 8cf27336-b00a-4fc7-ab9e-e5c8116d41e4 could not be found. {{(pid=120649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:42:16.977591 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-c2118b85-52d9-4da9-8209-e4b606501c45 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] 10.222.0.17 "GET /compute/v2.1/servers/8cf27336-b00a-4fc7-ab9e-e5c8116d41e4" status: 404 len: 111 microversion: 2.1 time: 0.031288 Sep 30 19:42:16.977591 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 595/1149] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:42:16 2022] GET /compute/v2.1/servers/8cf27336-b00a-4fc7-ab9e-e5c8116d41e4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 30 19:42:32.003424 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=25 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:42:32.004218 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=79,nova_cell1:INSERT=1 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:42:32.008775 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-751d76bf-c667-4681-a2cc-a5062d30d1f9 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1015038662", "imageRef": "7714d055-7d2c-4f56-9b14-45324361e286", "flavorRef": "452", "networks": [{"uuid": "3e9664b3-c8eb-4f77-bcba-0e5b00bd0f20"}]}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:42:32.061795 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.network.neutron [None req-751d76bf-c667-4681-a2cc-a5062d30d1f9 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] validate_networks() for [('3e9664b3-c8eb-4f77-bcba-0e5b00bd0f20', None, None, None, None, None)] {{(pid=120648) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 30 19:42:32.502541 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-751d76bf-c667-4681-a2cc-a5062d30d1f9 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Flavor limits 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 30 19:42:32.502993 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-751d76bf-c667-4681-a2cc-a5062d30d1f9 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Image limits 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 30 19:42:32.503457 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-751d76bf-c667-4681-a2cc-a5062d30d1f9 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Flavor pref 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 30 19:42:32.503860 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-751d76bf-c667-4681-a2cc-a5062d30d1f9 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Image pref 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 30 19:42:32.504288 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-751d76bf-c667-4681-a2cc-a5062d30d1f9 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 30 19:42:32.516694 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-751d76bf-c667-4681-a2cc-a5062d30d1f9 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:32.516694 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-751d76bf-c667-4681-a2cc-a5062d30d1f9 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:32.516694 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-751d76bf-c667-4681-a2cc-a5062d30d1f9 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:32.516694 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-751d76bf-c667-4681-a2cc-a5062d30d1f9 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:32.517149 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-751d76bf-c667-4681-a2cc-a5062d30d1f9 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:32.517149 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-751d76bf-c667-4681-a2cc-a5062d30d1f9 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:32.533060 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-751d76bf-c667-4681-a2cc-a5062d30d1f9 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Getting quotas for project 9fb45af355274456bc3759ebb76f6b72. Resources: {'instances', 'ram', 'cores'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 30 19:42:32.537219 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-751d76bf-c667-4681-a2cc-a5062d30d1f9 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Getting quotas for user c5b46acc6b57473fa4cab2e37b761748 and project 9fb45af355274456bc3759ebb76f6b72. Resources: {'instances', 'ram', 'cores'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 30 19:42:32.547928 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-751d76bf-c667-4681-a2cc-a5062d30d1f9 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Going to run 1 instances... {{(pid=120648) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 30 19:42:32.550382 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-751d76bf-c667-4681-a2cc-a5062d30d1f9 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] [instance: c5bb3890-05fb-4cea-a326-fa09221797a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7714d055-7d2c-4f56-9b14-45324361e286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 30 19:42:32.598847 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-751d76bf-c667-4681-a2cc-a5062d30d1f9 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.596908 Sep 30 19:42:32.599670 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 555/1150] 10.222.0.17 () {60 vars in 1147 bytes} [Fri Sep 30 19:42:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 30 19:42:32.610701 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-62ab16bd-39ac-4c6c-a525-004ce5d1cd05 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:42:32.611333 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-62ab16bd-39ac-4c6c-a525-004ce5d1cd05 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] [instance: c5bb3890-05fb-4cea-a326-fa09221797a6] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:42:32.614791 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:42:32.615437 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:42:32.670268 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-62ab16bd-39ac-4c6c-a525-004ce5d1cd05 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b46acc6b57473fa4cab2e37b761748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb45af355274456bc3759ebb76f6b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:42:32.677108 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-62ab16bd-39ac-4c6c-a525-004ce5d1cd05 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] 10.222.0.17 "GET /compute/v2.1/servers/c5bb3890-05fb-4cea-a326-fa09221797a6" status: 200 len: 1219 microversion: 2.1 time: 0.070266 Sep 30 19:42:32.677675 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 596/1151] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:42:32 2022] GET /compute/v2.1/servers/c5bb3890-05fb-4cea-a326-fa09221797a6 => generated 1219 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:42:33.700553 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-bf8093f5-362a-41f9-b762-6be572cccbe5 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:42:33.701171 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-bf8093f5-362a-41f9-b762-6be572cccbe5 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] [instance: c5bb3890-05fb-4cea-a326-fa09221797a6] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:42:33.707804 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bf8093f5-362a-41f9-b762-6be572cccbe5 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:33.708290 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bf8093f5-362a-41f9-b762-6be572cccbe5 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:33.708757 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bf8093f5-362a-41f9-b762-6be572cccbe5 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:33.709448 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bf8093f5-362a-41f9-b762-6be572cccbe5 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:33.709902 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bf8093f5-362a-41f9-b762-6be572cccbe5 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:33.710325 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bf8093f5-362a-41f9-b762-6be572cccbe5 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:33.780848 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-bf8093f5-362a-41f9-b762-6be572cccbe5 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b46acc6b57473fa4cab2e37b761748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb45af355274456bc3759ebb76f6b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:42:33.788894 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-bf8093f5-362a-41f9-b762-6be572cccbe5 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] 10.222.0.17 "GET /compute/v2.1/servers/c5bb3890-05fb-4cea-a326-fa09221797a6" status: 200 len: 1279 microversion: 2.1 time: 0.092217 Sep 30 19:42:33.789461 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 556/1152] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:42:33 2022] GET /compute/v2.1/servers/c5bb3890-05fb-4cea-a326-fa09221797a6 => generated 1279 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:42:34.813297 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-8a825b0b-1eec-401c-a375-27424990e8b4 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:42:34.813937 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-8a825b0b-1eec-401c-a375-27424990e8b4 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] [instance: c5bb3890-05fb-4cea-a326-fa09221797a6] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:42:34.821743 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8a825b0b-1eec-401c-a375-27424990e8b4 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:34.822313 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8a825b0b-1eec-401c-a375-27424990e8b4 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:34.822788 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8a825b0b-1eec-401c-a375-27424990e8b4 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:34.823635 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8a825b0b-1eec-401c-a375-27424990e8b4 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:34.824088 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8a825b0b-1eec-401c-a375-27424990e8b4 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:34.824541 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8a825b0b-1eec-401c-a375-27424990e8b4 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:34.958644 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-8a825b0b-1eec-401c-a375-27424990e8b4 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b46acc6b57473fa4cab2e37b761748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb45af355274456bc3759ebb76f6b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:42:34.966169 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-8a825b0b-1eec-401c-a375-27424990e8b4 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] 10.222.0.17 "GET /compute/v2.1/servers/c5bb3890-05fb-4cea-a326-fa09221797a6" status: 200 len: 1319 microversion: 2.1 time: 0.156792 Sep 30 19:42:34.966762 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 597/1153] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:42:34 2022] GET /compute/v2.1/servers/c5bb3890-05fb-4cea-a326-fa09221797a6 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:42:35.324926 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-6bbd2653-02e3-4a2b-be8e-ce9e8237a416 req-15af3a76-3eba-45c2-a8b0-6659237f1bf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5bb3890-05fb-4cea-a326-fa09221797a6", "tag": "b37f2c6a-e4fc-4a9e-94af-49f642842063"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:42:35.336105 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-6bbd2653-02e3-4a2b-be8e-ce9e8237a416 req-15af3a76-3eba-45c2-a8b0-6659237f1bf3 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:35.337146 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-6bbd2653-02e3-4a2b-be8e-ce9e8237a416 req-15af3a76-3eba-45c2-a8b0-6659237f1bf3 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:35.337579 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-6bbd2653-02e3-4a2b-be8e-ce9e8237a416 req-15af3a76-3eba-45c2-a8b0-6659237f1bf3 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:35.349213 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-6bbd2653-02e3-4a2b-be8e-ce9e8237a416 req-15af3a76-3eba-45c2-a8b0-6659237f1bf3 service nova] Creating event network-changed:b37f2c6a-e4fc-4a9e-94af-49f642842063 for instance c5bb3890-05fb-4cea-a326-fa09221797a6 on hv-cinder-86001 Sep 30 19:42:35.354339 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-6bbd2653-02e3-4a2b-be8e-ce9e8237a416 req-15af3a76-3eba-45c2-a8b0-6659237f1bf3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034418 Sep 30 19:42:35.355117 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 557/1154] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:42:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:42:35.990031 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-05eb2e2a-7dfc-4b19-9711-8fa6926eed21 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:42:35.990645 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-05eb2e2a-7dfc-4b19-9711-8fa6926eed21 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] [instance: c5bb3890-05fb-4cea-a326-fa09221797a6] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:42:35.997022 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-05eb2e2a-7dfc-4b19-9711-8fa6926eed21 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:35.997503 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-05eb2e2a-7dfc-4b19-9711-8fa6926eed21 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:35.997942 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-05eb2e2a-7dfc-4b19-9711-8fa6926eed21 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:35.998630 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-05eb2e2a-7dfc-4b19-9711-8fa6926eed21 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:35.999088 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-05eb2e2a-7dfc-4b19-9711-8fa6926eed21 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:35.999513 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-05eb2e2a-7dfc-4b19-9711-8fa6926eed21 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:36.125108 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-05eb2e2a-7dfc-4b19-9711-8fa6926eed21 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b46acc6b57473fa4cab2e37b761748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb45af355274456bc3759ebb76f6b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:42:36.132743 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-05eb2e2a-7dfc-4b19-9711-8fa6926eed21 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] 10.222.0.17 "GET /compute/v2.1/servers/c5bb3890-05fb-4cea-a326-fa09221797a6" status: 200 len: 1319 microversion: 2.1 time: 0.146513 Sep 30 19:42:36.133308 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 598/1155] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:42:35 2022] GET /compute/v2.1/servers/c5bb3890-05fb-4cea-a326-fa09221797a6 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:42:37.156076 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-8836de01-578f-47cb-a2de-c249289046c4 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:42:37.156789 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-8836de01-578f-47cb-a2de-c249289046c4 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] [instance: c5bb3890-05fb-4cea-a326-fa09221797a6] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:42:37.163229 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8836de01-578f-47cb-a2de-c249289046c4 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:37.163707 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8836de01-578f-47cb-a2de-c249289046c4 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:37.164142 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8836de01-578f-47cb-a2de-c249289046c4 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:37.164857 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8836de01-578f-47cb-a2de-c249289046c4 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:37.165321 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8836de01-578f-47cb-a2de-c249289046c4 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:37.165723 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8836de01-578f-47cb-a2de-c249289046c4 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:37.294071 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-8836de01-578f-47cb-a2de-c249289046c4 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b46acc6b57473fa4cab2e37b761748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb45af355274456bc3759ebb76f6b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:42:37.306866 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-8836de01-578f-47cb-a2de-c249289046c4 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] 10.222.0.17 "GET /compute/v2.1/servers/c5bb3890-05fb-4cea-a326-fa09221797a6" status: 200 len: 1319 microversion: 2.1 time: 0.155466 Sep 30 19:42:37.308065 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 558/1156] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:42:37 2022] GET /compute/v2.1/servers/c5bb3890-05fb-4cea-a326-fa09221797a6 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:42:38.329918 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-d79463c5-b944-45cf-b027-9b95200f3126 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:42:38.330512 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-d79463c5-b944-45cf-b027-9b95200f3126 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] [instance: c5bb3890-05fb-4cea-a326-fa09221797a6] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:42:38.337086 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d79463c5-b944-45cf-b027-9b95200f3126 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:38.337567 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d79463c5-b944-45cf-b027-9b95200f3126 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:38.338000 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d79463c5-b944-45cf-b027-9b95200f3126 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:38.338719 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d79463c5-b944-45cf-b027-9b95200f3126 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:38.339171 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d79463c5-b944-45cf-b027-9b95200f3126 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:38.339594 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d79463c5-b944-45cf-b027-9b95200f3126 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:38.468684 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-d79463c5-b944-45cf-b027-9b95200f3126 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b46acc6b57473fa4cab2e37b761748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb45af355274456bc3759ebb76f6b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:42:38.476285 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-d79463c5-b944-45cf-b027-9b95200f3126 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] 10.222.0.17 "GET /compute/v2.1/servers/c5bb3890-05fb-4cea-a326-fa09221797a6" status: 200 len: 1319 microversion: 2.1 time: 0.150292 Sep 30 19:42:38.476887 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 599/1157] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:42:38 2022] GET /compute/v2.1/servers/c5bb3890-05fb-4cea-a326-fa09221797a6 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:42:39.498860 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-614779b7-974d-49e8-b582-b9416bb142f0 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:42:39.499503 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-614779b7-974d-49e8-b582-b9416bb142f0 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] [instance: c5bb3890-05fb-4cea-a326-fa09221797a6] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:42:39.506076 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-614779b7-974d-49e8-b582-b9416bb142f0 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:39.506556 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-614779b7-974d-49e8-b582-b9416bb142f0 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:39.506988 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-614779b7-974d-49e8-b582-b9416bb142f0 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:39.507667 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-614779b7-974d-49e8-b582-b9416bb142f0 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:39.508117 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-614779b7-974d-49e8-b582-b9416bb142f0 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:39.508571 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-614779b7-974d-49e8-b582-b9416bb142f0 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:39.636674 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-614779b7-974d-49e8-b582-b9416bb142f0 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b46acc6b57473fa4cab2e37b761748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb45af355274456bc3759ebb76f6b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:42:39.644169 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-614779b7-974d-49e8-b582-b9416bb142f0 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] 10.222.0.17 "GET /compute/v2.1/servers/c5bb3890-05fb-4cea-a326-fa09221797a6" status: 200 len: 1319 microversion: 2.1 time: 0.149119 Sep 30 19:42:39.644763 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 559/1158] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:42:39 2022] GET /compute/v2.1/servers/c5bb3890-05fb-4cea-a326-fa09221797a6 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:42:40.673696 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-df3c8c08-bddc-4260-aea3-ed78ac7e85ee tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:42:40.674234 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-df3c8c08-bddc-4260-aea3-ed78ac7e85ee tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] [instance: c5bb3890-05fb-4cea-a326-fa09221797a6] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:42:40.680632 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-df3c8c08-bddc-4260-aea3-ed78ac7e85ee tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:40.681116 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-df3c8c08-bddc-4260-aea3-ed78ac7e85ee tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:40.681551 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-df3c8c08-bddc-4260-aea3-ed78ac7e85ee tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:40.682252 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-df3c8c08-bddc-4260-aea3-ed78ac7e85ee tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:40.682700 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-df3c8c08-bddc-4260-aea3-ed78ac7e85ee tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:40.683127 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-df3c8c08-bddc-4260-aea3-ed78ac7e85ee tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:40.810260 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-df3c8c08-bddc-4260-aea3-ed78ac7e85ee tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b46acc6b57473fa4cab2e37b761748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb45af355274456bc3759ebb76f6b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:42:40.817785 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-df3c8c08-bddc-4260-aea3-ed78ac7e85ee tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] 10.222.0.17 "GET /compute/v2.1/servers/c5bb3890-05fb-4cea-a326-fa09221797a6" status: 200 len: 1319 microversion: 2.1 time: 0.147983 Sep 30 19:42:40.818538 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 600/1159] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:42:40 2022] GET /compute/v2.1/servers/c5bb3890-05fb-4cea-a326-fa09221797a6 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:42:41.840888 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-fb3780a1-eb53-4f6d-b7eb-f407d5f04eb7 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:42:41.841503 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-fb3780a1-eb53-4f6d-b7eb-f407d5f04eb7 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] [instance: c5bb3890-05fb-4cea-a326-fa09221797a6] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:42:41.847846 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fb3780a1-eb53-4f6d-b7eb-f407d5f04eb7 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:41.848331 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fb3780a1-eb53-4f6d-b7eb-f407d5f04eb7 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:41.848803 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fb3780a1-eb53-4f6d-b7eb-f407d5f04eb7 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:41.849498 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fb3780a1-eb53-4f6d-b7eb-f407d5f04eb7 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:41.849952 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fb3780a1-eb53-4f6d-b7eb-f407d5f04eb7 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:41.850381 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fb3780a1-eb53-4f6d-b7eb-f407d5f04eb7 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:41.983967 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-fb3780a1-eb53-4f6d-b7eb-f407d5f04eb7 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b46acc6b57473fa4cab2e37b761748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb45af355274456bc3759ebb76f6b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:42:41.992465 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-fb3780a1-eb53-4f6d-b7eb-f407d5f04eb7 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] 10.222.0.17 "GET /compute/v2.1/servers/c5bb3890-05fb-4cea-a326-fa09221797a6" status: 200 len: 1319 microversion: 2.1 time: 0.155398 Sep 30 19:42:41.993043 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 560/1160] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:42:41 2022] GET /compute/v2.1/servers/c5bb3890-05fb-4cea-a326-fa09221797a6 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:42:43.016346 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-56154448-3f56-4a98-80ba-0a2cf312e28c tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:42:43.016993 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-56154448-3f56-4a98-80ba-0a2cf312e28c tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] [instance: c5bb3890-05fb-4cea-a326-fa09221797a6] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:42:43.019354 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell0:SELECT=2 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:42:43.025009 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-56154448-3f56-4a98-80ba-0a2cf312e28c tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:43.025495 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-56154448-3f56-4a98-80ba-0a2cf312e28c tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:43.026560 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-56154448-3f56-4a98-80ba-0a2cf312e28c tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:43.027271 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-56154448-3f56-4a98-80ba-0a2cf312e28c tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:43.027732 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-56154448-3f56-4a98-80ba-0a2cf312e28c tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:43.028164 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-56154448-3f56-4a98-80ba-0a2cf312e28c tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:43.152143 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-56154448-3f56-4a98-80ba-0a2cf312e28c tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b46acc6b57473fa4cab2e37b761748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb45af355274456bc3759ebb76f6b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:42:43.159729 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-56154448-3f56-4a98-80ba-0a2cf312e28c tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] 10.222.0.17 "GET /compute/v2.1/servers/c5bb3890-05fb-4cea-a326-fa09221797a6" status: 200 len: 1319 microversion: 2.1 time: 0.147309 Sep 30 19:42:43.160306 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 601/1161] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:42:43 2022] GET /compute/v2.1/servers/c5bb3890-05fb-4cea-a326-fa09221797a6 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:42:44.183509 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-f638435f-9d39-45ad-af42-8ba81b2fa747 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:42:44.184021 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-f638435f-9d39-45ad-af42-8ba81b2fa747 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] [instance: c5bb3890-05fb-4cea-a326-fa09221797a6] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:42:44.185984 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=2 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:42:44.186976 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=6 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:42:44.193474 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f638435f-9d39-45ad-af42-8ba81b2fa747 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:44.193948 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f638435f-9d39-45ad-af42-8ba81b2fa747 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:44.194378 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f638435f-9d39-45ad-af42-8ba81b2fa747 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:44.195064 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f638435f-9d39-45ad-af42-8ba81b2fa747 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:44.195511 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f638435f-9d39-45ad-af42-8ba81b2fa747 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:44.195930 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f638435f-9d39-45ad-af42-8ba81b2fa747 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:44.324467 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f638435f-9d39-45ad-af42-8ba81b2fa747 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b46acc6b57473fa4cab2e37b761748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb45af355274456bc3759ebb76f6b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:42:44.331968 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-f638435f-9d39-45ad-af42-8ba81b2fa747 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] 10.222.0.17 "GET /compute/v2.1/servers/c5bb3890-05fb-4cea-a326-fa09221797a6" status: 200 len: 1319 microversion: 2.1 time: 0.152980 Sep 30 19:42:44.332559 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 561/1162] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:42:44 2022] GET /compute/v2.1/servers/c5bb3890-05fb-4cea-a326-fa09221797a6 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:42:45.354503 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-1d117522-afe7-4801-b186-ca594ef16c2c tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:42:45.355117 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-1d117522-afe7-4801-b186-ca594ef16c2c tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] [instance: c5bb3890-05fb-4cea-a326-fa09221797a6] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:42:45.361684 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1d117522-afe7-4801-b186-ca594ef16c2c tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:45.362173 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1d117522-afe7-4801-b186-ca594ef16c2c tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:45.362615 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1d117522-afe7-4801-b186-ca594ef16c2c tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:45.363311 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1d117522-afe7-4801-b186-ca594ef16c2c tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:45.363771 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1d117522-afe7-4801-b186-ca594ef16c2c tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:45.364218 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1d117522-afe7-4801-b186-ca594ef16c2c tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:45.493486 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-1d117522-afe7-4801-b186-ca594ef16c2c tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b46acc6b57473fa4cab2e37b761748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb45af355274456bc3759ebb76f6b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:42:45.501033 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-1d117522-afe7-4801-b186-ca594ef16c2c tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] 10.222.0.17 "GET /compute/v2.1/servers/c5bb3890-05fb-4cea-a326-fa09221797a6" status: 200 len: 1319 microversion: 2.1 time: 0.150471 Sep 30 19:42:45.501608 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 602/1163] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:42:45 2022] GET /compute/v2.1/servers/c5bb3890-05fb-4cea-a326-fa09221797a6 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:42:45.958105 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-2e9b6854-c5a1-4d00-82fb-37a77c87b899 req-36d17fc1-d9af-44c9-ae17-96545381ee40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5bb3890-05fb-4cea-a326-fa09221797a6", "name": "network-vif-plugged", "status": "completed", "tag": "b37f2c6a-e4fc-4a9e-94af-49f642842063"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:42:45.969282 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-2e9b6854-c5a1-4d00-82fb-37a77c87b899 req-36d17fc1-d9af-44c9-ae17-96545381ee40 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:45.969769 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-2e9b6854-c5a1-4d00-82fb-37a77c87b899 req-36d17fc1-d9af-44c9-ae17-96545381ee40 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:45.970207 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-2e9b6854-c5a1-4d00-82fb-37a77c87b899 req-36d17fc1-d9af-44c9-ae17-96545381ee40 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:45.982148 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-2e9b6854-c5a1-4d00-82fb-37a77c87b899 req-36d17fc1-d9af-44c9-ae17-96545381ee40 service nova] Creating event network-vif-plugged:b37f2c6a-e4fc-4a9e-94af-49f642842063 for instance c5bb3890-05fb-4cea-a326-fa09221797a6 on hv-cinder-86001 Sep 30 19:42:45.987265 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-2e9b6854-c5a1-4d00-82fb-37a77c87b899 req-36d17fc1-d9af-44c9-ae17-96545381ee40 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032966 Sep 30 19:42:45.987851 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 562/1164] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:42:46.523941 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-2b15328d-17c7-47e5-ac6d-096d1eab4933 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:42:46.524516 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-2b15328d-17c7-47e5-ac6d-096d1eab4933 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] [instance: c5bb3890-05fb-4cea-a326-fa09221797a6] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:42:46.531457 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2b15328d-17c7-47e5-ac6d-096d1eab4933 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:46.531942 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2b15328d-17c7-47e5-ac6d-096d1eab4933 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:46.532449 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2b15328d-17c7-47e5-ac6d-096d1eab4933 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:46.533101 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2b15328d-17c7-47e5-ac6d-096d1eab4933 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:46.533558 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2b15328d-17c7-47e5-ac6d-096d1eab4933 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:46.533988 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-2b15328d-17c7-47e5-ac6d-096d1eab4933 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:46.660877 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-2b15328d-17c7-47e5-ac6d-096d1eab4933 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b46acc6b57473fa4cab2e37b761748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb45af355274456bc3759ebb76f6b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:42:46.669436 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-2b15328d-17c7-47e5-ac6d-096d1eab4933 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] 10.222.0.17 "GET /compute/v2.1/servers/c5bb3890-05fb-4cea-a326-fa09221797a6" status: 200 len: 1319 microversion: 2.1 time: 0.149423 Sep 30 19:42:46.670007 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 603/1165] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:42:46 2022] GET /compute/v2.1/servers/c5bb3890-05fb-4cea-a326-fa09221797a6 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:42:47.692901 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-3a42b8de-9af1-4392-86d4-bc58f13c5e71 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:42:47.693594 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-3a42b8de-9af1-4392-86d4-bc58f13c5e71 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] [instance: c5bb3890-05fb-4cea-a326-fa09221797a6] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:42:47.700178 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3a42b8de-9af1-4392-86d4-bc58f13c5e71 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:47.700680 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3a42b8de-9af1-4392-86d4-bc58f13c5e71 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:47.701115 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3a42b8de-9af1-4392-86d4-bc58f13c5e71 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:47.701796 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3a42b8de-9af1-4392-86d4-bc58f13c5e71 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:47.702275 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3a42b8de-9af1-4392-86d4-bc58f13c5e71 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:47.702697 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3a42b8de-9af1-4392-86d4-bc58f13c5e71 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:47.828305 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-3a42b8de-9af1-4392-86d4-bc58f13c5e71 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b46acc6b57473fa4cab2e37b761748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb45af355274456bc3759ebb76f6b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:42:47.835933 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-3a42b8de-9af1-4392-86d4-bc58f13c5e71 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] 10.222.0.17 "GET /compute/v2.1/servers/c5bb3890-05fb-4cea-a326-fa09221797a6" status: 200 len: 1319 microversion: 2.1 time: 0.147953 Sep 30 19:42:47.836519 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 563/1166] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:42:47 2022] GET /compute/v2.1/servers/c5bb3890-05fb-4cea-a326-fa09221797a6 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:42:48.860410 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-3be3c042-68fd-46f1-96e0-a9a7a1b449d1 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:42:48.861017 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-3be3c042-68fd-46f1-96e0-a9a7a1b449d1 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] [instance: c5bb3890-05fb-4cea-a326-fa09221797a6] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:42:48.867367 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3be3c042-68fd-46f1-96e0-a9a7a1b449d1 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:48.867847 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3be3c042-68fd-46f1-96e0-a9a7a1b449d1 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:48.868279 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3be3c042-68fd-46f1-96e0-a9a7a1b449d1 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:48.868988 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3be3c042-68fd-46f1-96e0-a9a7a1b449d1 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:48.869433 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3be3c042-68fd-46f1-96e0-a9a7a1b449d1 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:48.869854 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-3be3c042-68fd-46f1-96e0-a9a7a1b449d1 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:48.997303 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-3be3c042-68fd-46f1-96e0-a9a7a1b449d1 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b46acc6b57473fa4cab2e37b761748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb45af355274456bc3759ebb76f6b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:42:49.004793 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-3be3c042-68fd-46f1-96e0-a9a7a1b449d1 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] 10.222.0.17 "GET /compute/v2.1/servers/c5bb3890-05fb-4cea-a326-fa09221797a6" status: 200 len: 1509 microversion: 2.1 time: 0.148221 Sep 30 19:42:49.005356 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 604/1167] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:42:48 2022] GET /compute/v2.1/servers/c5bb3890-05fb-4cea-a326-fa09221797a6 => generated 1509 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:42:49.027764 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-97bdad65-9c4d-41e9-87d0-8e7710c6887b tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "32639dd0-0d12-4f69-8f9d-79076dcaa0d4", "device": "/dev/sdb"}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:42:49.030149 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-97bdad65-9c4d-41e9-87d0-8e7710c6887b tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] [instance: c5bb3890-05fb-4cea-a326-fa09221797a6] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:42:49.036743 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-97bdad65-9c4d-41e9-87d0-8e7710c6887b tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:49.037224 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-97bdad65-9c4d-41e9-87d0-8e7710c6887b tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:49.037664 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-97bdad65-9c4d-41e9-87d0-8e7710c6887b tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:49.038354 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-97bdad65-9c4d-41e9-87d0-8e7710c6887b tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:42:49.038812 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-97bdad65-9c4d-41e9-87d0-8e7710c6887b tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:42:49.039239 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-97bdad65-9c4d-41e9-87d0-8e7710c6887b tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:42:49.300680 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-97bdad65-9c4d-41e9-87d0-8e7710c6887b tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] 10.222.0.17 "POST /compute/v2.1/servers/c5bb3890-05fb-4cea-a326-fa09221797a6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277192 Sep 30 19:42:49.301316 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 564/1168] 10.222.0.17 () {60 vars in 1323 bytes} [Fri Sep 30 19:42:49 2022] POST /compute/v2.1/servers/c5bb3890-05fb-4cea-a326-fa09221797a6/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:43:11.750621 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-e79da9cf-9a09-4592-a162-7bc6c9ccd86e tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:43:11.751101 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-e79da9cf-9a09-4592-a162-7bc6c9ccd86e tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] [instance: c5bb3890-05fb-4cea-a326-fa09221797a6] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:43:11.753256 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_api:SELECT=20 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:43:11.753901 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell1:SELECT=48 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:43:11.759215 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e79da9cf-9a09-4592-a162-7bc6c9ccd86e tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:43:11.759697 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e79da9cf-9a09-4592-a162-7bc6c9ccd86e tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:43:11.760665 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e79da9cf-9a09-4592-a162-7bc6c9ccd86e tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:43:11.761369 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e79da9cf-9a09-4592-a162-7bc6c9ccd86e tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:43:11.761799 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e79da9cf-9a09-4592-a162-7bc6c9ccd86e tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:43:11.762218 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e79da9cf-9a09-4592-a162-7bc6c9ccd86e tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:43:11.841249 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.objects.instance [None req-e79da9cf-9a09-4592-a162-7bc6c9ccd86e tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lazy-loading 'services' on Instance uuid c5bb3890-05fb-4cea-a326-fa09221797a6 {{(pid=120649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 30 19:43:11.912018 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-e79da9cf-9a09-4592-a162-7bc6c9ccd86e tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c5bb3890-05fb-4cea-a326-fa09221797a6/os-volume_attachments/32639dd0-0d12-4f69-8f9d-79076dcaa0d4" status: 202 len: 0 microversion: 2.1 time: 0.165139 Sep 30 19:43:11.912638 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 605/1169] 10.222.0.17 () {58 vars in 1416 bytes} [Fri Sep 30 19:43:11 2022] DELETE /compute/v2.1/servers/c5bb3890-05fb-4cea-a326-fa09221797a6/os-volume_attachments/32639dd0-0d12-4f69-8f9d-79076dcaa0d4 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 30 19:43:13.030325 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:43:13.031221 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:43:13.035510 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-ce0deffd-665c-47c4-9426-5ed4cb0e16fd tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:43:13.036337 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-ce0deffd-665c-47c4-9426-5ed4cb0e16fd tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] [instance: c5bb3890-05fb-4cea-a326-fa09221797a6] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:43:13.043842 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ce0deffd-665c-47c4-9426-5ed4cb0e16fd tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:43:13.044323 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ce0deffd-665c-47c4-9426-5ed4cb0e16fd tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:43:13.044803 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ce0deffd-665c-47c4-9426-5ed4cb0e16fd tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:43:13.045475 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ce0deffd-665c-47c4-9426-5ed4cb0e16fd tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:43:13.045931 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ce0deffd-665c-47c4-9426-5ed4cb0e16fd tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:43:13.046357 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ce0deffd-665c-47c4-9426-5ed4cb0e16fd tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:43:13.072056 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-ce0deffd-665c-47c4-9426-5ed4cb0e16fd tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] [instance: c5bb3890-05fb-4cea-a326-fa09221797a6] Going to try to terminate instance {{(pid=120648) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 30 19:43:13.143943 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-ce0deffd-665c-47c4-9426-5ed4cb0e16fd tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c5bb3890-05fb-4cea-a326-fa09221797a6" status: 204 len: 0 microversion: 2.1 time: 0.114967 Sep 30 19:43:13.144560 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 565/1170] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 30 19:43:13 2022] DELETE /compute/v2.1/servers/c5bb3890-05fb-4cea-a326-fa09221797a6 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 30 19:43:13.155898 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-78c29122-a4e5-46b8-b867-319c0cef98c2 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:43:13.156628 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-78c29122-a4e5-46b8-b867-319c0cef98c2 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] [instance: c5bb3890-05fb-4cea-a326-fa09221797a6] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:43:13.163038 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-78c29122-a4e5-46b8-b867-319c0cef98c2 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:43:13.163507 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-78c29122-a4e5-46b8-b867-319c0cef98c2 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:43:13.163946 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-78c29122-a4e5-46b8-b867-319c0cef98c2 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:43:13.164674 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-78c29122-a4e5-46b8-b867-319c0cef98c2 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:43:13.165131 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-78c29122-a4e5-46b8-b867-319c0cef98c2 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:43:13.165562 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-78c29122-a4e5-46b8-b867-319c0cef98c2 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:43:13.291360 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-78c29122-a4e5-46b8-b867-319c0cef98c2 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b46acc6b57473fa4cab2e37b761748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb45af355274456bc3759ebb76f6b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:43:13.298996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-78c29122-a4e5-46b8-b867-319c0cef98c2 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] 10.222.0.17 "GET /compute/v2.1/servers/c5bb3890-05fb-4cea-a326-fa09221797a6" status: 200 len: 1515 microversion: 2.1 time: 0.149729 Sep 30 19:43:13.299558 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 606/1171] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:43:13 2022] GET /compute/v2.1/servers/c5bb3890-05fb-4cea-a326-fa09221797a6 => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:43:14.322979 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-948e7f78-b025-4e06-8a72-fa3568155656 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:43:14.323715 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-948e7f78-b025-4e06-8a72-fa3568155656 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] [instance: c5bb3890-05fb-4cea-a326-fa09221797a6] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:43:14.330494 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-948e7f78-b025-4e06-8a72-fa3568155656 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:43:14.330968 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-948e7f78-b025-4e06-8a72-fa3568155656 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:43:14.331401 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-948e7f78-b025-4e06-8a72-fa3568155656 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:43:14.332081 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-948e7f78-b025-4e06-8a72-fa3568155656 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:43:14.332572 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-948e7f78-b025-4e06-8a72-fa3568155656 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:43:14.332984 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-948e7f78-b025-4e06-8a72-fa3568155656 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:43:14.459853 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-948e7f78-b025-4e06-8a72-fa3568155656 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b46acc6b57473fa4cab2e37b761748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb45af355274456bc3759ebb76f6b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:43:14.467471 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-948e7f78-b025-4e06-8a72-fa3568155656 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] 10.222.0.17 "GET /compute/v2.1/servers/c5bb3890-05fb-4cea-a326-fa09221797a6" status: 200 len: 1515 microversion: 2.1 time: 0.148774 Sep 30 19:43:14.468035 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 566/1172] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:43:14 2022] GET /compute/v2.1/servers/c5bb3890-05fb-4cea-a326-fa09221797a6 => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:43:15.490859 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-00e3e503-a0a9-46b4-afbb-419e6c004ffc tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:43:15.491475 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-00e3e503-a0a9-46b4-afbb-419e6c004ffc tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] [instance: c5bb3890-05fb-4cea-a326-fa09221797a6] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:43:15.497909 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-00e3e503-a0a9-46b4-afbb-419e6c004ffc tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:43:15.498393 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-00e3e503-a0a9-46b4-afbb-419e6c004ffc tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:43:15.498829 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-00e3e503-a0a9-46b4-afbb-419e6c004ffc tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:43:15.499523 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-00e3e503-a0a9-46b4-afbb-419e6c004ffc tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:43:15.499980 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-00e3e503-a0a9-46b4-afbb-419e6c004ffc tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:43:15.500433 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-00e3e503-a0a9-46b4-afbb-419e6c004ffc tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:43:15.632206 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-00e3e503-a0a9-46b4-afbb-419e6c004ffc tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b46acc6b57473fa4cab2e37b761748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb45af355274456bc3759ebb76f6b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:43:15.640701 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-00e3e503-a0a9-46b4-afbb-419e6c004ffc tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] 10.222.0.17 "GET /compute/v2.1/servers/c5bb3890-05fb-4cea-a326-fa09221797a6" status: 200 len: 1515 microversion: 2.1 time: 0.153754 Sep 30 19:43:15.641268 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 607/1173] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:43:15 2022] GET /compute/v2.1/servers/c5bb3890-05fb-4cea-a326-fa09221797a6 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:43:15.828393 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-bda51a98-71bb-4d4f-83d0-3bbc85a94fef req-dd5efadd-45a2-47fe-a642-8e22244944af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5bb3890-05fb-4cea-a326-fa09221797a6", "name": "network-vif-deleted", "tag": "b37f2c6a-e4fc-4a9e-94af-49f642842063"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:43:15.838666 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-bda51a98-71bb-4d4f-83d0-3bbc85a94fef req-dd5efadd-45a2-47fe-a642-8e22244944af service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:43:15.839148 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-bda51a98-71bb-4d4f-83d0-3bbc85a94fef req-dd5efadd-45a2-47fe-a642-8e22244944af service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:43:15.839580 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-bda51a98-71bb-4d4f-83d0-3bbc85a94fef req-dd5efadd-45a2-47fe-a642-8e22244944af service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:43:15.850916 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-bda51a98-71bb-4d4f-83d0-3bbc85a94fef req-dd5efadd-45a2-47fe-a642-8e22244944af service nova] Creating event network-vif-deleted:b37f2c6a-e4fc-4a9e-94af-49f642842063 for instance c5bb3890-05fb-4cea-a326-fa09221797a6 on hv-cinder-86001 Sep 30 19:43:15.855674 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-bda51a98-71bb-4d4f-83d0-3bbc85a94fef req-dd5efadd-45a2-47fe-a642-8e22244944af service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030979 Sep 30 19:43:15.856265 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 567/1174] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 30 19:43:16.663125 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-c0733e8f-0304-4408-bc61-faac34700745 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:43:16.663740 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-c0733e8f-0304-4408-bc61-faac34700745 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] [instance: c5bb3890-05fb-4cea-a326-fa09221797a6] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:43:16.670780 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c0733e8f-0304-4408-bc61-faac34700745 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:43:16.671272 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c0733e8f-0304-4408-bc61-faac34700745 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:43:16.671755 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c0733e8f-0304-4408-bc61-faac34700745 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:43:16.672487 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c0733e8f-0304-4408-bc61-faac34700745 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:43:16.672947 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c0733e8f-0304-4408-bc61-faac34700745 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:43:16.673379 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c0733e8f-0304-4408-bc61-faac34700745 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:43:16.704681 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c0733e8f-0304-4408-bc61-faac34700745 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:43:16.705164 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c0733e8f-0304-4408-bc61-faac34700745 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:43:16.705604 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c0733e8f-0304-4408-bc61-faac34700745 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:43:16.706053 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.objects.instance [None req-c0733e8f-0304-4408-bc61-faac34700745 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lazy-loading 'fault' on Instance uuid c5bb3890-05fb-4cea-a326-fa09221797a6 {{(pid=120649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 30 19:43:16.747883 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-c0733e8f-0304-4408-bc61-faac34700745 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b46acc6b57473fa4cab2e37b761748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb45af355274456bc3759ebb76f6b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:43:16.755034 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-c0733e8f-0304-4408-bc61-faac34700745 tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] 10.222.0.17 "GET /compute/v2.1/servers/c5bb3890-05fb-4cea-a326-fa09221797a6" status: 200 len: 1309 microversion: 2.1 time: 0.095987 Sep 30 19:43:16.755600 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 608/1175] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:43:16 2022] GET /compute/v2.1/servers/c5bb3890-05fb-4cea-a326-fa09221797a6 => generated 1309 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:43:17.779623 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-3adbec3d-4114-4ee9-b649-a5bbd323071d tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:43:17.780315 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-3adbec3d-4114-4ee9-b649-a5bbd323071d tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] [instance: c5bb3890-05fb-4cea-a326-fa09221797a6] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:43:17.786803 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3adbec3d-4114-4ee9-b649-a5bbd323071d tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:43:17.787288 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3adbec3d-4114-4ee9-b649-a5bbd323071d tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:43:17.787724 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3adbec3d-4114-4ee9-b649-a5bbd323071d tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:43:17.788442 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3adbec3d-4114-4ee9-b649-a5bbd323071d tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:43:17.788900 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3adbec3d-4114-4ee9-b649-a5bbd323071d tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:43:17.789327 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3adbec3d-4114-4ee9-b649-a5bbd323071d tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:43:17.805190 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.wsgi [None req-3adbec3d-4114-4ee9-b649-a5bbd323071d tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] HTTP exception thrown: Instance c5bb3890-05fb-4cea-a326-fa09221797a6 could not be found. Sep 30 19:43:17.806815 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-3adbec3d-4114-4ee9-b649-a5bbd323071d tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Request method failure captured: Sep 30 19:43:17.806815 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: request: GET /compute/v2.1/servers/c5bb3890-05fb-4cea-a326-fa09221797a6 HTTP/1.1 Sep 30 19:43:17.806815 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 30 19:43:17.806815 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 30 19:43:17.806815 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Connection: close Sep 30 19:43:17.806815 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Length: 0 Sep 30 19:43:17.806815 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 30 19:43:17.806815 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Host: 10.222.0.17 Sep 30 19:43:17.806815 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 30 19:43:17.806815 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 30 19:43:17.806815 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjN0Y-hGt_GD3stRKMr_vK4THzhA8g-1_ZUYy6whZqm5ymIsh6jYnUOSCbZUO9w7k8WOep0MIDucIxF2uhEso5ikNMAJbUCD6UFySYjn2_kyNsF8k0tucqu0vnwSu7voblG5j7X4qypH1z_aDqw2z6r38cP9NRhWljOhPGNWae4ChtNls Sep 30 19:43:17.806815 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 30 19:43:17.806815 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 30 19:43:17.806815 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 30 19:43:17.806815 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 30 19:43:17.806815 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 30 19:43:17.806815 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 30 19:43:17.806815 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Id: 9fb45af355274456bc3759ebb76f6b72 Sep 30 19:43:17.806815 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-VolumesSnapshotTestJSON-278290515 Sep 30 19:43:17.806815 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 30 19:43:17.806815 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 30 19:43:17.808641 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9fb45af355274456bc3759ebb76f6b72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9fb45af355274456bc3759ebb76f6b72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9fb45af355274456bc3759ebb76f6b72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9fb45af355274456bc3759ebb76f6b72"}]}] Sep 30 19:43:17.808641 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-VolumesSnapshotTestJSON-278290515 Sep 30 19:43:17.808641 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Id: 9fb45af355274456bc3759ebb76f6b72 Sep 30 19:43:17.808641 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-278290515 Sep 30 19:43:17.808641 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User: tempest-VolumesSnapshotTestJSON-278290515-project Sep 30 19:43:17.808641 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 30 19:43:17.808641 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 30 19:43:17.808641 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Id: c5b46acc6b57473fa4cab2e37b761748 Sep 30 19:43:17.808641 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-VolumesSnapshotTestJSON-278290515-project Sep 30 19:43:17.808641 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: method: > Sep 30 19:43:17.808641 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: exception: Instance c5bb3890-05fb-4cea-a326-fa09221797a6 could not be found. Sep 30 19:43:17.808641 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: action_args: {'id': 'c5bb3890-05fb-4cea-a326-fa09221797a6'} Sep 30 19:43:17.809916 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:43:17.809916 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:43:17.809916 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 30 19:43:17.809916 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 30 19:43:17.809916 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 30 19:43:17.809916 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 30 19:43:17.809916 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 30 19:43:17.809916 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 30 19:43:17.809916 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 30 19:43:17.809916 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 30 19:43:17.809916 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5bb3890-05fb-4cea-a326-fa09221797a6 could not be found. Sep 30 19:43:17.809916 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:43:17.809916 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:43:17.809916 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:43:17.809916 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:43:17.809916 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:43:17.809916 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:43:17.809916 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:43:17.809916 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:43:17.809916 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:43:17.811615 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:43:17.811615 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 30 19:43:17.811615 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 30 19:43:17.811615 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 30 19:43:17.811615 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 30 19:43:17.811615 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 30 19:43:17.811615 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 30 19:43:17.811615 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5bb3890-05fb-4cea-a326-fa09221797a6 could not be found. Sep 30 19:43:17.811615 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:43:17.811615 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:43:17.811615 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:43:17.811615 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:43:17.811615 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:43:17.811615 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:43:17.811615 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:43:17.811615 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:43:17.811615 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5bb3890-05fb-4cea-a326-fa09221797a6 could not be found. Sep 30 19:43:17.811615 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:43:17.813228 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-3adbec3d-4114-4ee9-b649-a5bbd323071d tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] Returning 404 to user: Instance c5bb3890-05fb-4cea-a326-fa09221797a6 could not be found. {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:43:17.813228 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-3adbec3d-4114-4ee9-b649-a5bbd323071d tempest-VolumesSnapshotTestJSON-278290515 tempest-VolumesSnapshotTestJSON-278290515-project] 10.222.0.17 "GET /compute/v2.1/servers/c5bb3890-05fb-4cea-a326-fa09221797a6" status: 404 len: 111 microversion: 2.1 time: 0.033780 Sep 30 19:43:17.813228 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 568/1176] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:43:17 2022] GET /compute/v2.1/servers/c5bb3890-05fb-4cea-a326-fa09221797a6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 30 19:44:02.903804 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-47302e4e-e01f-4fca-8ce6-a6db28cf4f5f tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Action: 'create', calling method: .version_select at 0x7f62227f60d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1189052628", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvx3tDeSn9G4S2PNKSCmbMg4JAkZUULBk7Wk3+IexErk/Kc+HvuxlpOtafm0ET3ffF2YCp+80lZSqbQHhrsyWDUiZFQk52zV4VyAldMp1R0jtkg4ZddjxzLz9zXXWbySg=="}} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:44:02.909746 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_api:SELECT=10 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:44:02.910395 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:44:02.923372 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.quota [None req-47302e4e-e01f-4fca-8ce6-a6db28cf4f5f tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Getting quotas for project 9b7a0b8124ba4b51bcb69cb5ff459819. Resources: {'key_pairs'} {{(pid=120649) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 30 19:44:02.927101 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.quota [None req-47302e4e-e01f-4fca-8ce6-a6db28cf4f5f tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Getting quotas for user ed107378a0a24db8962ac5da8c6dd961 and project 9b7a0b8124ba4b51bcb69cb5ff459819. Resources: {'key_pairs'} {{(pid=120649) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 30 19:44:02.948525 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-47302e4e-e01f-4fca-8ce6-a6db28cf4f5f tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.048712 Sep 30 19:44:02.949110 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 609/1177] 10.222.0.17 () {60 vars in 1159 bytes} [Fri Sep 30 19:44:02 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:44:02.998420 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-3b257141-c002-4494-a1e4-a43b2bb3037f tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-576338653", "imageRef": "dcefb52a-11d5-482e-ac9c-79984b0db256", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1189052628", "networks": [{"uuid": "090a777c-7f29-447e-a509-b035592c6036"}]}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:44:03.007366 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:44:03.008012 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:44:03.159329 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.network.neutron [None req-3b257141-c002-4494-a1e4-a43b2bb3037f tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] validate_networks() for [('090a777c-7f29-447e-a509-b035592c6036', None, None, None, None, None)] {{(pid=120648) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 30 19:44:03.523889 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-3b257141-c002-4494-a1e4-a43b2bb3037f tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Flavor limits 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 30 19:44:03.524308 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-3b257141-c002-4494-a1e4-a43b2bb3037f tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Image limits 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 30 19:44:03.524825 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-3b257141-c002-4494-a1e4-a43b2bb3037f tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Flavor pref 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 30 19:44:03.525230 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-3b257141-c002-4494-a1e4-a43b2bb3037f tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Image pref 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 30 19:44:03.525634 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-3b257141-c002-4494-a1e4-a43b2bb3037f tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 30 19:44:03.534609 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3b257141-c002-4494-a1e4-a43b2bb3037f tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:03.535079 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3b257141-c002-4494-a1e4-a43b2bb3037f tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:03.535508 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3b257141-c002-4494-a1e4-a43b2bb3037f tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:03.536219 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3b257141-c002-4494-a1e4-a43b2bb3037f tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:03.536946 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3b257141-c002-4494-a1e4-a43b2bb3037f tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:03.537364 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3b257141-c002-4494-a1e4-a43b2bb3037f tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:03.553872 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-3b257141-c002-4494-a1e4-a43b2bb3037f tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Getting quotas for project 9b7a0b8124ba4b51bcb69cb5ff459819. Resources: {'instances', 'ram', 'cores'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 30 19:44:03.557658 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-3b257141-c002-4494-a1e4-a43b2bb3037f tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Getting quotas for user ed107378a0a24db8962ac5da8c6dd961 and project 9b7a0b8124ba4b51bcb69cb5ff459819. Resources: {'instances', 'ram', 'cores'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 30 19:44:03.568152 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-3b257141-c002-4494-a1e4-a43b2bb3037f tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Going to run 1 instances... {{(pid=120648) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 30 19:44:03.570337 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-3b257141-c002-4494-a1e4-a43b2bb3037f tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] [instance: 5745aded-4ca8-48ee-b8be-eff2e1a7368a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dcefb52a-11d5-482e-ac9c-79984b0db256',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 30 19:44:03.618414 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-3b257141-c002-4494-a1e4-a43b2bb3037f tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.624444 Sep 30 19:44:03.619279 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 569/1178] 10.222.0.17 () {60 vars in 1147 bytes} [Fri Sep 30 19:44:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 30 19:44:03.630087 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-c3992035-9f85-46a9-a87b-4be0f859ba52 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:44:03.630707 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-c3992035-9f85-46a9-a87b-4be0f859ba52 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] [instance: 5745aded-4ca8-48ee-b8be-eff2e1a7368a] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:44:03.790239 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-c3992035-9f85-46a9-a87b-4be0f859ba52 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed107378a0a24db8962ac5da8c6dd961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7a0b8124ba4b51bcb69cb5ff459819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:44:03.797324 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-c3992035-9f85-46a9-a87b-4be0f859ba52 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] 10.222.0.17 "GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a" status: 200 len: 1258 microversion: 2.1 time: 0.171183 Sep 30 19:44:03.797973 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 610/1179] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:44:03 2022] GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a => generated 1258 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:44:04.821804 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e4469cb9-15c7-433f-8c46-3a9f19ad3453 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:44:04.822427 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-e4469cb9-15c7-433f-8c46-3a9f19ad3453 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] [instance: 5745aded-4ca8-48ee-b8be-eff2e1a7368a] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:44:04.829096 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e4469cb9-15c7-433f-8c46-3a9f19ad3453 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:04.829596 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e4469cb9-15c7-433f-8c46-3a9f19ad3453 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:04.830057 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e4469cb9-15c7-433f-8c46-3a9f19ad3453 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:04.830727 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e4469cb9-15c7-433f-8c46-3a9f19ad3453 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:04.831178 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e4469cb9-15c7-433f-8c46-3a9f19ad3453 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:04.831678 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e4469cb9-15c7-433f-8c46-3a9f19ad3453 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:04.915380 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-e4469cb9-15c7-433f-8c46-3a9f19ad3453 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed107378a0a24db8962ac5da8c6dd961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7a0b8124ba4b51bcb69cb5ff459819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:44:04.923511 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-e4469cb9-15c7-433f-8c46-3a9f19ad3453 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] 10.222.0.17 "GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a" status: 200 len: 1316 microversion: 2.1 time: 0.105664 Sep 30 19:44:04.924074 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 570/1180] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:44:04 2022] GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a => generated 1316 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:44:05.947105 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-b44509dc-ea9e-4535-acbf-45c17d155c0f tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:44:05.948357 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-b44509dc-ea9e-4535-acbf-45c17d155c0f tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] [instance: 5745aded-4ca8-48ee-b8be-eff2e1a7368a] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:44:05.956650 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b44509dc-ea9e-4535-acbf-45c17d155c0f tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:05.957213 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b44509dc-ea9e-4535-acbf-45c17d155c0f tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:05.957715 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b44509dc-ea9e-4535-acbf-45c17d155c0f tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:05.958477 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b44509dc-ea9e-4535-acbf-45c17d155c0f tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:05.958932 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b44509dc-ea9e-4535-acbf-45c17d155c0f tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:05.959352 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b44509dc-ea9e-4535-acbf-45c17d155c0f tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:06.092201 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-b44509dc-ea9e-4535-acbf-45c17d155c0f tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed107378a0a24db8962ac5da8c6dd961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7a0b8124ba4b51bcb69cb5ff459819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:44:06.100653 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-b44509dc-ea9e-4535-acbf-45c17d155c0f tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] 10.222.0.17 "GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a" status: 200 len: 1358 microversion: 2.1 time: 0.157449 Sep 30 19:44:06.101824 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 611/1181] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:44:05 2022] GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:44:07.125634 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-3b4c4561-fe4d-42cc-b049-2016c0b6f89b tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:44:07.126248 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-3b4c4561-fe4d-42cc-b049-2016c0b6f89b tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] [instance: 5745aded-4ca8-48ee-b8be-eff2e1a7368a] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:44:07.134466 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3b4c4561-fe4d-42cc-b049-2016c0b6f89b tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:07.135250 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3b4c4561-fe4d-42cc-b049-2016c0b6f89b tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:07.135700 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3b4c4561-fe4d-42cc-b049-2016c0b6f89b tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:07.136435 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3b4c4561-fe4d-42cc-b049-2016c0b6f89b tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:07.136919 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3b4c4561-fe4d-42cc-b049-2016c0b6f89b tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:07.137342 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3b4c4561-fe4d-42cc-b049-2016c0b6f89b tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:07.266016 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-3b4c4561-fe4d-42cc-b049-2016c0b6f89b tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed107378a0a24db8962ac5da8c6dd961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7a0b8124ba4b51bcb69cb5ff459819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:44:07.275365 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-3b4c4561-fe4d-42cc-b049-2016c0b6f89b tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] 10.222.0.17 "GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a" status: 200 len: 1358 microversion: 2.1 time: 0.154218 Sep 30 19:44:07.275950 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 571/1182] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:44:07 2022] GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:44:08.298955 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-dcae67dd-bfea-427c-abe9-13493c36cf23 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:44:08.299569 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-dcae67dd-bfea-427c-abe9-13493c36cf23 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] [instance: 5745aded-4ca8-48ee-b8be-eff2e1a7368a] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:44:08.306042 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-dcae67dd-bfea-427c-abe9-13493c36cf23 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:08.306527 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-dcae67dd-bfea-427c-abe9-13493c36cf23 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:08.306968 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-dcae67dd-bfea-427c-abe9-13493c36cf23 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:08.307663 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-dcae67dd-bfea-427c-abe9-13493c36cf23 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:08.308123 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-dcae67dd-bfea-427c-abe9-13493c36cf23 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:08.308590 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-dcae67dd-bfea-427c-abe9-13493c36cf23 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:08.449466 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-dcae67dd-bfea-427c-abe9-13493c36cf23 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed107378a0a24db8962ac5da8c6dd961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7a0b8124ba4b51bcb69cb5ff459819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:44:08.458599 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-dcae67dd-bfea-427c-abe9-13493c36cf23 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] 10.222.0.17 "GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a" status: 200 len: 1358 microversion: 2.1 time: 0.163440 Sep 30 19:44:08.459249 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 612/1183] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:44:08 2022] GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:44:09.482950 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-0ce65a5e-53cb-45df-b5cd-c269ba326eaa tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:44:09.483549 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-0ce65a5e-53cb-45df-b5cd-c269ba326eaa tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] [instance: 5745aded-4ca8-48ee-b8be-eff2e1a7368a] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:44:09.492188 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0ce65a5e-53cb-45df-b5cd-c269ba326eaa tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:09.492188 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0ce65a5e-53cb-45df-b5cd-c269ba326eaa tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:09.492188 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0ce65a5e-53cb-45df-b5cd-c269ba326eaa tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:09.492188 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0ce65a5e-53cb-45df-b5cd-c269ba326eaa tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:09.492691 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0ce65a5e-53cb-45df-b5cd-c269ba326eaa tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:09.492691 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0ce65a5e-53cb-45df-b5cd-c269ba326eaa tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:09.622794 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-0ce65a5e-53cb-45df-b5cd-c269ba326eaa tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed107378a0a24db8962ac5da8c6dd961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7a0b8124ba4b51bcb69cb5ff459819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:44:09.640315 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-0ce65a5e-53cb-45df-b5cd-c269ba326eaa tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] 10.222.0.17 "GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a" status: 200 len: 1358 microversion: 2.1 time: 0.161993 Sep 30 19:44:09.641266 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 572/1184] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:44:09 2022] GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:44:10.673567 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-0a3ecb63-1b64-485c-bbec-886cac033fb4 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:44:10.674876 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-0a3ecb63-1b64-485c-bbec-886cac033fb4 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] [instance: 5745aded-4ca8-48ee-b8be-eff2e1a7368a] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:44:10.682860 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0a3ecb63-1b64-485c-bbec-886cac033fb4 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:10.683339 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0a3ecb63-1b64-485c-bbec-886cac033fb4 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:10.683972 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0a3ecb63-1b64-485c-bbec-886cac033fb4 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:10.684706 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0a3ecb63-1b64-485c-bbec-886cac033fb4 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:10.685957 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0a3ecb63-1b64-485c-bbec-886cac033fb4 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:10.686392 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0a3ecb63-1b64-485c-bbec-886cac033fb4 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:10.860357 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-0a3ecb63-1b64-485c-bbec-886cac033fb4 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed107378a0a24db8962ac5da8c6dd961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7a0b8124ba4b51bcb69cb5ff459819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:44:10.878058 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-0a3ecb63-1b64-485c-bbec-886cac033fb4 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] 10.222.0.17 "GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a" status: 200 len: 1358 microversion: 2.1 time: 0.217994 Sep 30 19:44:10.878940 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 613/1185] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:44:10 2022] GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a => generated 1358 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:44:11.900964 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-4e38040b-508a-45e7-8eb8-b3ec96f7771c tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:44:11.901614 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-4e38040b-508a-45e7-8eb8-b3ec96f7771c tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] [instance: 5745aded-4ca8-48ee-b8be-eff2e1a7368a] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:44:11.908511 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4e38040b-508a-45e7-8eb8-b3ec96f7771c tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:11.909001 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4e38040b-508a-45e7-8eb8-b3ec96f7771c tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:11.909443 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4e38040b-508a-45e7-8eb8-b3ec96f7771c tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:11.910142 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4e38040b-508a-45e7-8eb8-b3ec96f7771c tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:11.910601 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4e38040b-508a-45e7-8eb8-b3ec96f7771c tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:11.911028 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4e38040b-508a-45e7-8eb8-b3ec96f7771c tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:12.059619 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-4e38040b-508a-45e7-8eb8-b3ec96f7771c tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed107378a0a24db8962ac5da8c6dd961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7a0b8124ba4b51bcb69cb5ff459819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:44:12.068240 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-4e38040b-508a-45e7-8eb8-b3ec96f7771c tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] 10.222.0.17 "GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a" status: 200 len: 1358 microversion: 2.1 time: 0.171286 Sep 30 19:44:12.068827 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 573/1186] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:44:11 2022] GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:44:13.093986 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-9efee280-8e66-4189-91f9-2f98a18fa682 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:44:13.094604 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-9efee280-8e66-4189-91f9-2f98a18fa682 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] [instance: 5745aded-4ca8-48ee-b8be-eff2e1a7368a] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:44:13.101267 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9efee280-8e66-4189-91f9-2f98a18fa682 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:13.101701 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9efee280-8e66-4189-91f9-2f98a18fa682 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:13.102140 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9efee280-8e66-4189-91f9-2f98a18fa682 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:13.102837 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9efee280-8e66-4189-91f9-2f98a18fa682 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:13.103292 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9efee280-8e66-4189-91f9-2f98a18fa682 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:13.103722 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9efee280-8e66-4189-91f9-2f98a18fa682 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:13.228578 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-9efee280-8e66-4189-91f9-2f98a18fa682 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed107378a0a24db8962ac5da8c6dd961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7a0b8124ba4b51bcb69cb5ff459819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:44:13.236977 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-9efee280-8e66-4189-91f9-2f98a18fa682 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] 10.222.0.17 "GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a" status: 200 len: 1358 microversion: 2.1 time: 0.146841 Sep 30 19:44:13.237541 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 614/1187] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:44:13 2022] GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:44:14.259134 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-cceb2466-d5cd-4db0-9d9d-101bf7cda6f4 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:44:14.259683 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-cceb2466-d5cd-4db0-9d9d-101bf7cda6f4 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] [instance: 5745aded-4ca8-48ee-b8be-eff2e1a7368a] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:44:14.262011 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=2 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:44:14.262666 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=6 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:44:14.268748 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cceb2466-d5cd-4db0-9d9d-101bf7cda6f4 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:14.269227 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cceb2466-d5cd-4db0-9d9d-101bf7cda6f4 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:14.269663 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cceb2466-d5cd-4db0-9d9d-101bf7cda6f4 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:14.270379 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cceb2466-d5cd-4db0-9d9d-101bf7cda6f4 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:14.270830 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cceb2466-d5cd-4db0-9d9d-101bf7cda6f4 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:14.271254 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cceb2466-d5cd-4db0-9d9d-101bf7cda6f4 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:14.398706 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-cceb2466-d5cd-4db0-9d9d-101bf7cda6f4 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed107378a0a24db8962ac5da8c6dd961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7a0b8124ba4b51bcb69cb5ff459819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:44:14.407126 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-cceb2466-d5cd-4db0-9d9d-101bf7cda6f4 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] 10.222.0.17 "GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a" status: 200 len: 1358 microversion: 2.1 time: 0.151983 Sep 30 19:44:14.407686 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 574/1188] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:44:14 2022] GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:44:15.430048 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-1f85c605-3621-44a1-b440-df4c30423be2 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:44:15.430640 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-1f85c605-3621-44a1-b440-df4c30423be2 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] [instance: 5745aded-4ca8-48ee-b8be-eff2e1a7368a] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:44:15.432578 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell0:SELECT=6 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:44:15.438209 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1f85c605-3621-44a1-b440-df4c30423be2 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:15.438690 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1f85c605-3621-44a1-b440-df4c30423be2 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:15.439128 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1f85c605-3621-44a1-b440-df4c30423be2 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:15.439821 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1f85c605-3621-44a1-b440-df4c30423be2 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:15.440275 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1f85c605-3621-44a1-b440-df4c30423be2 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:15.440729 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-1f85c605-3621-44a1-b440-df4c30423be2 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:15.569742 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-1f85c605-3621-44a1-b440-df4c30423be2 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed107378a0a24db8962ac5da8c6dd961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7a0b8124ba4b51bcb69cb5ff459819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:44:15.577441 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-1f85c605-3621-44a1-b440-df4c30423be2 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] 10.222.0.17 "GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a" status: 200 len: 1358 microversion: 2.1 time: 0.151295 Sep 30 19:44:15.578019 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 615/1189] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:44:15 2022] GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:44:15.918019 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-74f72a9e-2091-49be-904e-7fbc3228810e req-4600de65-00b5-4c2e-82ad-2c662b1ed967 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5745aded-4ca8-48ee-b8be-eff2e1a7368a", "tag": "a9e96422-58e5-4cac-bb52-22ea80779c20"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:44:15.929211 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-74f72a9e-2091-49be-904e-7fbc3228810e req-4600de65-00b5-4c2e-82ad-2c662b1ed967 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:15.929770 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-74f72a9e-2091-49be-904e-7fbc3228810e req-4600de65-00b5-4c2e-82ad-2c662b1ed967 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:15.930424 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-74f72a9e-2091-49be-904e-7fbc3228810e req-4600de65-00b5-4c2e-82ad-2c662b1ed967 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:15.943613 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-74f72a9e-2091-49be-904e-7fbc3228810e req-4600de65-00b5-4c2e-82ad-2c662b1ed967 service nova] Creating event network-changed:a9e96422-58e5-4cac-bb52-22ea80779c20 for instance 5745aded-4ca8-48ee-b8be-eff2e1a7368a on hv-cinder-86001 Sep 30 19:44:15.948548 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-74f72a9e-2091-49be-904e-7fbc3228810e req-4600de65-00b5-4c2e-82ad-2c662b1ed967 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034349 Sep 30 19:44:15.949143 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 575/1190] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 30 19:44:16.599805 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-7a0e8ed1-21a2-4dc2-b55e-b1bcdac50b15 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:44:16.600478 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-7a0e8ed1-21a2-4dc2-b55e-b1bcdac50b15 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] [instance: 5745aded-4ca8-48ee-b8be-eff2e1a7368a] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:44:16.607319 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7a0e8ed1-21a2-4dc2-b55e-b1bcdac50b15 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:16.607808 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7a0e8ed1-21a2-4dc2-b55e-b1bcdac50b15 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:16.608779 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7a0e8ed1-21a2-4dc2-b55e-b1bcdac50b15 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:16.609562 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7a0e8ed1-21a2-4dc2-b55e-b1bcdac50b15 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:16.610031 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7a0e8ed1-21a2-4dc2-b55e-b1bcdac50b15 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:16.610470 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7a0e8ed1-21a2-4dc2-b55e-b1bcdac50b15 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:16.736977 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-7a0e8ed1-21a2-4dc2-b55e-b1bcdac50b15 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed107378a0a24db8962ac5da8c6dd961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7a0b8124ba4b51bcb69cb5ff459819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:44:16.744615 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-7a0e8ed1-21a2-4dc2-b55e-b1bcdac50b15 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] 10.222.0.17 "GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a" status: 200 len: 1358 microversion: 2.1 time: 0.148677 Sep 30 19:44:16.745189 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 616/1191] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:44:16 2022] GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:44:17.775124 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-b72a4b6e-da7e-486a-87ed-efc5ff89cd68 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:44:17.775845 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-b72a4b6e-da7e-486a-87ed-efc5ff89cd68 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] [instance: 5745aded-4ca8-48ee-b8be-eff2e1a7368a] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:44:17.781938 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b72a4b6e-da7e-486a-87ed-efc5ff89cd68 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:17.782424 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b72a4b6e-da7e-486a-87ed-efc5ff89cd68 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:17.782866 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b72a4b6e-da7e-486a-87ed-efc5ff89cd68 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:17.783587 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b72a4b6e-da7e-486a-87ed-efc5ff89cd68 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:17.784046 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b72a4b6e-da7e-486a-87ed-efc5ff89cd68 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:17.784502 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b72a4b6e-da7e-486a-87ed-efc5ff89cd68 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:17.912768 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-b72a4b6e-da7e-486a-87ed-efc5ff89cd68 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed107378a0a24db8962ac5da8c6dd961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7a0b8124ba4b51bcb69cb5ff459819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:44:17.920293 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-b72a4b6e-da7e-486a-87ed-efc5ff89cd68 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] 10.222.0.17 "GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a" status: 200 len: 1358 microversion: 2.1 time: 0.149895 Sep 30 19:44:17.920881 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 576/1192] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:44:17 2022] GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:44:18.943154 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-7932ab03-2e31-444b-9c4a-24f7e995b92e tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:44:18.943602 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-7932ab03-2e31-444b-9c4a-24f7e995b92e tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] [instance: 5745aded-4ca8-48ee-b8be-eff2e1a7368a] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:44:18.950151 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7932ab03-2e31-444b-9c4a-24f7e995b92e tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:18.950632 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7932ab03-2e31-444b-9c4a-24f7e995b92e tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:18.951127 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7932ab03-2e31-444b-9c4a-24f7e995b92e tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:18.951852 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7932ab03-2e31-444b-9c4a-24f7e995b92e tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:18.952321 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7932ab03-2e31-444b-9c4a-24f7e995b92e tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:18.952761 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7932ab03-2e31-444b-9c4a-24f7e995b92e tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:19.078532 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-7932ab03-2e31-444b-9c4a-24f7e995b92e tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed107378a0a24db8962ac5da8c6dd961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7a0b8124ba4b51bcb69cb5ff459819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:44:19.086110 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-7932ab03-2e31-444b-9c4a-24f7e995b92e tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] 10.222.0.17 "GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a" status: 200 len: 1358 microversion: 2.1 time: 0.147174 Sep 30 19:44:19.086673 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 617/1193] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:44:18 2022] GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:44:20.108342 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-0256927b-5d17-4eac-833e-7a02ffdb1ea7 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:44:20.109561 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-0256927b-5d17-4eac-833e-7a02ffdb1ea7 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] [instance: 5745aded-4ca8-48ee-b8be-eff2e1a7368a] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:44:20.115914 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0256927b-5d17-4eac-833e-7a02ffdb1ea7 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:20.116417 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0256927b-5d17-4eac-833e-7a02ffdb1ea7 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:20.116853 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0256927b-5d17-4eac-833e-7a02ffdb1ea7 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:20.117541 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0256927b-5d17-4eac-833e-7a02ffdb1ea7 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:20.117996 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0256927b-5d17-4eac-833e-7a02ffdb1ea7 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:20.118420 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0256927b-5d17-4eac-833e-7a02ffdb1ea7 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:20.245088 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-0256927b-5d17-4eac-833e-7a02ffdb1ea7 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed107378a0a24db8962ac5da8c6dd961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7a0b8124ba4b51bcb69cb5ff459819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:44:20.252610 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-0256927b-5d17-4eac-833e-7a02ffdb1ea7 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] 10.222.0.17 "GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a" status: 200 len: 1358 microversion: 2.1 time: 0.148072 Sep 30 19:44:20.253437 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 577/1194] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:44:20 2022] GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:44:21.275627 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-dad56334-d7a4-466d-a259-76ccb44c4ff5 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:44:21.276261 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-dad56334-d7a4-466d-a259-76ccb44c4ff5 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] [instance: 5745aded-4ca8-48ee-b8be-eff2e1a7368a] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:44:21.282716 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-dad56334-d7a4-466d-a259-76ccb44c4ff5 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:21.283198 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-dad56334-d7a4-466d-a259-76ccb44c4ff5 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:21.283626 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-dad56334-d7a4-466d-a259-76ccb44c4ff5 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:21.284309 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-dad56334-d7a4-466d-a259-76ccb44c4ff5 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:21.284850 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-dad56334-d7a4-466d-a259-76ccb44c4ff5 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:21.285272 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-dad56334-d7a4-466d-a259-76ccb44c4ff5 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:21.418158 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-dad56334-d7a4-466d-a259-76ccb44c4ff5 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed107378a0a24db8962ac5da8c6dd961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7a0b8124ba4b51bcb69cb5ff459819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:44:21.426277 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-dad56334-d7a4-466d-a259-76ccb44c4ff5 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] 10.222.0.17 "GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a" status: 200 len: 1358 microversion: 2.1 time: 0.154563 Sep 30 19:44:21.426836 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 618/1195] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:44:21 2022] GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:44:22.448781 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-86ac72de-bb8c-483d-ba9d-4d785642cc33 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:44:22.449426 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-86ac72de-bb8c-483d-ba9d-4d785642cc33 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] [instance: 5745aded-4ca8-48ee-b8be-eff2e1a7368a] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:44:22.456288 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-86ac72de-bb8c-483d-ba9d-4d785642cc33 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:22.456809 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-86ac72de-bb8c-483d-ba9d-4d785642cc33 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:22.457242 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-86ac72de-bb8c-483d-ba9d-4d785642cc33 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:22.457931 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-86ac72de-bb8c-483d-ba9d-4d785642cc33 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:22.458385 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-86ac72de-bb8c-483d-ba9d-4d785642cc33 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:22.458810 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-86ac72de-bb8c-483d-ba9d-4d785642cc33 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:22.674885 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-86ac72de-bb8c-483d-ba9d-4d785642cc33 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed107378a0a24db8962ac5da8c6dd961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7a0b8124ba4b51bcb69cb5ff459819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:44:22.682474 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-86ac72de-bb8c-483d-ba9d-4d785642cc33 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] 10.222.0.17 "GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a" status: 200 len: 1358 microversion: 2.1 time: 0.237628 Sep 30 19:44:22.683042 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 578/1196] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:44:22 2022] GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a => generated 1358 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:44:23.682588 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [req-209ab238-b4ad-4268-9115-382d95f64ca2 req-ab5cd3ad-4028-4b1c-ae6d-5699f21a2bfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5745aded-4ca8-48ee-b8be-eff2e1a7368a", "name": "network-vif-plugged", "status": "completed", "tag": "a9e96422-58e5-4cac-bb52-22ea80779c20"}]} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:44:23.689437 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 30 19:44:23.689652 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Fri Sep 30 19:44:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.17) !!! Sep 30 19:44:23.696495 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-209ab238-b4ad-4268-9115-382d95f64ca2 req-ab5cd3ad-4028-4b1c-ae6d-5699f21a2bfa service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:23.696991 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-209ab238-b4ad-4268-9115-382d95f64ca2 req-ab5cd3ad-4028-4b1c-ae6d-5699f21a2bfa service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:23.697430 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-209ab238-b4ad-4268-9115-382d95f64ca2 req-ab5cd3ad-4028-4b1c-ae6d-5699f21a2bfa service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:23.707235 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-06e2b534-9a6a-4b6a-bc81-65e8ab767861 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:44:23.709726 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-06e2b534-9a6a-4b6a-bc81-65e8ab767861 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] [instance: 5745aded-4ca8-48ee-b8be-eff2e1a7368a] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:44:23.709888 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.compute.server_external_events [req-209ab238-b4ad-4268-9115-382d95f64ca2 req-ab5cd3ad-4028-4b1c-ae6d-5699f21a2bfa service nova] Creating event network-vif-plugged:a9e96422-58e5-4cac-bb52-22ea80779c20 for instance 5745aded-4ca8-48ee-b8be-eff2e1a7368a on hv-cinder-86001 Sep 30 19:44:23.714871 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [req-209ab238-b4ad-4268-9115-382d95f64ca2 req-ab5cd3ad-4028-4b1c-ae6d-5699f21a2bfa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035931 Sep 30 19:44:23.715639 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 619/1197] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:44:23.718071 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-06e2b534-9a6a-4b6a-bc81-65e8ab767861 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:23.718651 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-06e2b534-9a6a-4b6a-bc81-65e8ab767861 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:23.718998 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-06e2b534-9a6a-4b6a-bc81-65e8ab767861 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:23.719693 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-06e2b534-9a6a-4b6a-bc81-65e8ab767861 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:23.720142 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-06e2b534-9a6a-4b6a-bc81-65e8ab767861 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:23.720620 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-06e2b534-9a6a-4b6a-bc81-65e8ab767861 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:23.851765 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-06e2b534-9a6a-4b6a-bc81-65e8ab767861 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed107378a0a24db8962ac5da8c6dd961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7a0b8124ba4b51bcb69cb5ff459819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:44:23.860009 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-06e2b534-9a6a-4b6a-bc81-65e8ab767861 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] 10.222.0.17 "GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a" status: 200 len: 1358 microversion: 2.1 time: 0.158555 Sep 30 19:44:23.860599 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 579/1198] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:44:23 2022] GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:44:24.884211 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-9048b5d3-367f-4553-a3f5-c87cb1411601 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:44:24.884933 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-9048b5d3-367f-4553-a3f5-c87cb1411601 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] [instance: 5745aded-4ca8-48ee-b8be-eff2e1a7368a] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:44:24.891516 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9048b5d3-367f-4553-a3f5-c87cb1411601 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:24.891990 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9048b5d3-367f-4553-a3f5-c87cb1411601 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:24.892451 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9048b5d3-367f-4553-a3f5-c87cb1411601 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:24.893136 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9048b5d3-367f-4553-a3f5-c87cb1411601 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:24.893585 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9048b5d3-367f-4553-a3f5-c87cb1411601 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:24.894010 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-9048b5d3-367f-4553-a3f5-c87cb1411601 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:25.019327 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-9048b5d3-367f-4553-a3f5-c87cb1411601 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed107378a0a24db8962ac5da8c6dd961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7a0b8124ba4b51bcb69cb5ff459819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:44:25.026951 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-9048b5d3-367f-4553-a3f5-c87cb1411601 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] 10.222.0.17 "GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a" status: 200 len: 1358 microversion: 2.1 time: 0.147499 Sep 30 19:44:25.027509 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 620/1199] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:44:24 2022] GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:44:26.050381 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-b008365a-cccd-4a7e-a886-6368cf47ff07 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:44:26.050965 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-b008365a-cccd-4a7e-a886-6368cf47ff07 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] [instance: 5745aded-4ca8-48ee-b8be-eff2e1a7368a] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:44:26.057538 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b008365a-cccd-4a7e-a886-6368cf47ff07 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:26.058041 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b008365a-cccd-4a7e-a886-6368cf47ff07 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:26.058469 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b008365a-cccd-4a7e-a886-6368cf47ff07 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:26.059144 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b008365a-cccd-4a7e-a886-6368cf47ff07 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:26.059593 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b008365a-cccd-4a7e-a886-6368cf47ff07 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:26.060015 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b008365a-cccd-4a7e-a886-6368cf47ff07 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:26.185330 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-b008365a-cccd-4a7e-a886-6368cf47ff07 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed107378a0a24db8962ac5da8c6dd961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7a0b8124ba4b51bcb69cb5ff459819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:44:26.193034 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-b008365a-cccd-4a7e-a886-6368cf47ff07 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] 10.222.0.17 "GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a" status: 200 len: 1548 microversion: 2.1 time: 0.147157 Sep 30 19:44:26.193596 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 580/1200] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:44:26 2022] GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a => generated 1548 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:44:26.214865 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-7c5b9bfe-77f5-421d-b223-b396d5260eb7 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:44:26.215484 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-7c5b9bfe-77f5-421d-b223-b396d5260eb7 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] [instance: 5745aded-4ca8-48ee-b8be-eff2e1a7368a] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:44:26.222168 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7c5b9bfe-77f5-421d-b223-b396d5260eb7 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:26.222650 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7c5b9bfe-77f5-421d-b223-b396d5260eb7 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:26.223094 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7c5b9bfe-77f5-421d-b223-b396d5260eb7 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:26.223790 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7c5b9bfe-77f5-421d-b223-b396d5260eb7 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:26.224250 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7c5b9bfe-77f5-421d-b223-b396d5260eb7 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:26.224707 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7c5b9bfe-77f5-421d-b223-b396d5260eb7 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:26.354438 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-7c5b9bfe-77f5-421d-b223-b396d5260eb7 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed107378a0a24db8962ac5da8c6dd961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7a0b8124ba4b51bcb69cb5ff459819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:44:26.362076 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-7c5b9bfe-77f5-421d-b223-b396d5260eb7 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] 10.222.0.17 "GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a" status: 200 len: 1548 microversion: 2.1 time: 0.151064 Sep 30 19:44:26.362648 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 621/1201] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:44:26 2022] GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:44:26.383429 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-3e610fd9-c3cb-4572-a943-b7b66bdc1600 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:44:26.388278 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-3e610fd9-c3cb-4572-a943-b7b66bdc1600 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ed107378a0a24db8962ac5da8c6dd961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7a0b8124ba4b51bcb69cb5ff459819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:44:26.389079 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-3e610fd9-c3cb-4572-a943-b7b66bdc1600 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Searching by: {'deleted': False, 'project_id': '9b7a0b8124ba4b51bcb69cb5ff459819'} {{(pid=120648) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 30 19:44:26.396176 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3e610fd9-c3cb-4572-a943-b7b66bdc1600 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:26.396725 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3e610fd9-c3cb-4572-a943-b7b66bdc1600 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:26.397173 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3e610fd9-c3cb-4572-a943-b7b66bdc1600 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:26.397897 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3e610fd9-c3cb-4572-a943-b7b66bdc1600 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:26.398357 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3e610fd9-c3cb-4572-a943-b7b66bdc1600 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:26.398805 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3e610fd9-c3cb-4572-a943-b7b66bdc1600 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:26.488868 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.multi_cell_list [None req-3e610fd9-c3cb-4572-a943-b7b66bdc1600 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120648) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 30 19:44:26.583660 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-3e610fd9-c3cb-4572-a943-b7b66bdc1600 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.203868 Sep 30 19:44:26.584166 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 581/1202] 10.222.0.17 () {58 vars in 1125 bytes} [Fri Sep 30 19:44:26 2022] GET /compute/v2.1/servers => generated 342 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 30 19:44:26.596291 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-155e9753-3e07-4157-a97f-37b255862a12 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:44:26.596943 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-155e9753-3e07-4157-a97f-37b255862a12 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] [instance: 5745aded-4ca8-48ee-b8be-eff2e1a7368a] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:44:26.602768 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-155e9753-3e07-4157-a97f-37b255862a12 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:26.603278 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-155e9753-3e07-4157-a97f-37b255862a12 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:26.603719 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-155e9753-3e07-4157-a97f-37b255862a12 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:26.604435 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-155e9753-3e07-4157-a97f-37b255862a12 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:26.604892 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-155e9753-3e07-4157-a97f-37b255862a12 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:26.605318 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-155e9753-3e07-4157-a97f-37b255862a12 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:26.730355 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-155e9753-3e07-4157-a97f-37b255862a12 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed107378a0a24db8962ac5da8c6dd961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7a0b8124ba4b51bcb69cb5ff459819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:44:26.737965 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-155e9753-3e07-4157-a97f-37b255862a12 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] 10.222.0.17 "GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a" status: 200 len: 1548 microversion: 2.1 time: 0.146142 Sep 30 19:44:26.738523 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 622/1203] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:44:26 2022] GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a => generated 1548 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:44:28.299006 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-f0437286-40b5-400c-99c3-49c3431d5fb7 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc6caef7-c033-4a97-ab4a-ff04ede48747"}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:44:28.301373 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-f0437286-40b5-400c-99c3-49c3431d5fb7 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] [instance: 5745aded-4ca8-48ee-b8be-eff2e1a7368a] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:44:28.307651 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f0437286-40b5-400c-99c3-49c3431d5fb7 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:28.308138 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f0437286-40b5-400c-99c3-49c3431d5fb7 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:28.308622 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f0437286-40b5-400c-99c3-49c3431d5fb7 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:28.309311 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f0437286-40b5-400c-99c3-49c3431d5fb7 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:28.309763 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f0437286-40b5-400c-99c3-49c3431d5fb7 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:28.310183 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f0437286-40b5-400c-99c3-49c3431d5fb7 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:28.564614 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-f0437286-40b5-400c-99c3-49c3431d5fb7 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] 10.222.0.17 "POST /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269691 Sep 30 19:44:28.565213 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 582/1204] 10.222.0.17 () {60 vars in 1323 bytes} [Fri Sep 30 19:44:28 2022] POST /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a/os-volume_attachments => generated 194 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:44:36.147618 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-cdcae420-7817-417e-ba21-c567664b6421 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:44:36.148228 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-cdcae420-7817-417e-ba21-c567664b6421 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] [instance: 5745aded-4ca8-48ee-b8be-eff2e1a7368a] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:44:36.150842 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:44:36.156941 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-cdcae420-7817-417e-ba21-c567664b6421 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:36.157427 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-cdcae420-7817-417e-ba21-c567664b6421 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:36.157859 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-cdcae420-7817-417e-ba21-c567664b6421 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:36.158545 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-cdcae420-7817-417e-ba21-c567664b6421 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:36.158993 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-cdcae420-7817-417e-ba21-c567664b6421 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:36.159415 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-cdcae420-7817-417e-ba21-c567664b6421 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:36.164373 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell1:SELECT=69 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:44:36.290027 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-cdcae420-7817-417e-ba21-c567664b6421 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed107378a0a24db8962ac5da8c6dd961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7a0b8124ba4b51bcb69cb5ff459819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:44:36.298140 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-cdcae420-7817-417e-ba21-c567664b6421 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] 10.222.0.17 "GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a" status: 200 len: 1594 microversion: 2.1 time: 0.154392 Sep 30 19:44:36.298705 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 623/1205] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:44:36 2022] GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a => generated 1594 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:44:38.111530 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=2 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:44:38.115631 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-d9602758-c5e9-40e9-bc09-02a009c34bdd req-ed078dc7-ae96-4e56-b641-0f7ad08d99d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5745aded-4ca8-48ee-b8be-eff2e1a7368a", "tag": "a9e96422-58e5-4cac-bb52-22ea80779c20"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:44:38.124002 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:44:38.131441 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-d9602758-c5e9-40e9-bc09-02a009c34bdd req-ed078dc7-ae96-4e56-b641-0f7ad08d99d9 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:38.131950 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-d9602758-c5e9-40e9-bc09-02a009c34bdd req-ed078dc7-ae96-4e56-b641-0f7ad08d99d9 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:38.132404 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-d9602758-c5e9-40e9-bc09-02a009c34bdd req-ed078dc7-ae96-4e56-b641-0f7ad08d99d9 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:38.136815 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:44:38.146183 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-d9602758-c5e9-40e9-bc09-02a009c34bdd req-ed078dc7-ae96-4e56-b641-0f7ad08d99d9 service nova] Creating event network-changed:a9e96422-58e5-4cac-bb52-22ea80779c20 for instance 5745aded-4ca8-48ee-b8be-eff2e1a7368a on hv-cinder-86001 Sep 30 19:44:38.151804 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-d9602758-c5e9-40e9-bc09-02a009c34bdd req-ed078dc7-ae96-4e56-b641-0f7ad08d99d9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041692 Sep 30 19:44:38.152759 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 583/1206] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:44:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:44:39.247759 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-bf7e7c39-3e82-4b9f-8ba6-45dc4cb4cfba tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-715180392"}} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:44:39.248294 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-bf7e7c39-3e82-4b9f-8ba6-45dc4cb4cfba tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] [instance: 5745aded-4ca8-48ee-b8be-eff2e1a7368a] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:44:39.255347 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-bf7e7c39-3e82-4b9f-8ba6-45dc4cb4cfba tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:39.255872 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-bf7e7c39-3e82-4b9f-8ba6-45dc4cb4cfba tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:39.256332 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-bf7e7c39-3e82-4b9f-8ba6-45dc4cb4cfba tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:39.257054 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-bf7e7c39-3e82-4b9f-8ba6-45dc4cb4cfba tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:39.257550 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-bf7e7c39-3e82-4b9f-8ba6-45dc4cb4cfba tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:39.258017 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-bf7e7c39-3e82-4b9f-8ba6-45dc4cb4cfba tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:39.384168 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.network.security_group_api [None req-bf7e7c39-3e82-4b9f-8ba6-45dc4cb4cfba tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Adding security group 0672685f-52a7-415a-9814-d0139728860f to port a9e96422-58e5-4cac-bb52-22ea80779c20 Sep 30 19:44:39.694562 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-bf7e7c39-3e82-4b9f-8ba6-45dc4cb4cfba tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] 10.222.0.17 "POST /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a/action" status: 202 len: 0 microversion: 2.1 time: 0.450982 Sep 30 19:44:39.695170 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 624/1207] 10.222.0.17 () {60 vars in 1278 bytes} [Fri Sep 30 19:44:39 2022] POST /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a/action => generated 0 bytes in 452 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 30 19:44:39.704748 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-fda006d5-f52c-4ea8-81e3-ead1342e1564 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:44:39.706049 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-fda006d5-f52c-4ea8-81e3-ead1342e1564 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] [instance: 5745aded-4ca8-48ee-b8be-eff2e1a7368a] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:44:39.712822 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fda006d5-f52c-4ea8-81e3-ead1342e1564 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:39.714300 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fda006d5-f52c-4ea8-81e3-ead1342e1564 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:39.714759 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fda006d5-f52c-4ea8-81e3-ead1342e1564 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:39.715614 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fda006d5-f52c-4ea8-81e3-ead1342e1564 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:39.716076 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fda006d5-f52c-4ea8-81e3-ead1342e1564 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:39.716527 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fda006d5-f52c-4ea8-81e3-ead1342e1564 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:39.862354 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-fda006d5-f52c-4ea8-81e3-ead1342e1564 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed107378a0a24db8962ac5da8c6dd961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7a0b8124ba4b51bcb69cb5ff459819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:44:39.871353 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-fda006d5-f52c-4ea8-81e3-ead1342e1564 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] 10.222.0.17 "GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a" status: 200 len: 1759 microversion: 2.1 time: 0.171848 Sep 30 19:44:39.871928 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 584/1208] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:44:39 2022] GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a => generated 1759 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:44:40.168086 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [req-0ec352ab-dab0-4449-8fcb-d4bf7f1dfa1a req-cfd11d71-2334-4196-afb5-dd7aa5e2804b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5745aded-4ca8-48ee-b8be-eff2e1a7368a", "tag": "a9e96422-58e5-4cac-bb52-22ea80779c20"}]} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:44:40.177674 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-0ec352ab-dab0-4449-8fcb-d4bf7f1dfa1a req-cfd11d71-2334-4196-afb5-dd7aa5e2804b service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:40.178224 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-0ec352ab-dab0-4449-8fcb-d4bf7f1dfa1a req-cfd11d71-2334-4196-afb5-dd7aa5e2804b service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:40.178720 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-0ec352ab-dab0-4449-8fcb-d4bf7f1dfa1a req-cfd11d71-2334-4196-afb5-dd7aa5e2804b service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:40.190385 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.compute.server_external_events [req-0ec352ab-dab0-4449-8fcb-d4bf7f1dfa1a req-cfd11d71-2334-4196-afb5-dd7aa5e2804b service nova] Creating event network-changed:a9e96422-58e5-4cac-bb52-22ea80779c20 for instance 5745aded-4ca8-48ee-b8be-eff2e1a7368a on hv-cinder-86001 Sep 30 19:44:40.195448 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [req-0ec352ab-dab0-4449-8fcb-d4bf7f1dfa1a req-cfd11d71-2334-4196-afb5-dd7aa5e2804b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031011 Sep 30 19:44:40.196061 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 625/1209] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 30 19:44:54.438368 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-d2f4782e-ea4f-43c8-80c0-b8992409884c tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-578857741", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-106744613", "security_groups": [{"name": "tempest-secgroup-smoke-1336083125"}], "block_device_mapping_v2": [{"uuid": "90ab73a9-af3f-4e51-948c-6383b417be22", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5eacc127-b1a0-451d-80fc-349e698deff5"}]}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:44:54.449189 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=3 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:44:54.449835 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=7 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:44:54.550667 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.network.neutron [None req-d2f4782e-ea4f-43c8-80c0-b8992409884c tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] validate_networks() for [('5eacc127-b1a0-451d-80fc-349e698deff5', None, None, None, None, None)] {{(pid=120648) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 30 19:44:54.908051 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-d2f4782e-ea4f-43c8-80c0-b8992409884c tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Flavor limits 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 30 19:44:54.908507 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-d2f4782e-ea4f-43c8-80c0-b8992409884c tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Image limits 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 30 19:44:54.908987 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-d2f4782e-ea4f-43c8-80c0-b8992409884c tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Flavor pref 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 30 19:44:54.909391 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-d2f4782e-ea4f-43c8-80c0-b8992409884c tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Image pref 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 30 19:44:54.909801 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-d2f4782e-ea4f-43c8-80c0-b8992409884c tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 30 19:44:54.918620 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d2f4782e-ea4f-43c8-80c0-b8992409884c tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:54.919102 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d2f4782e-ea4f-43c8-80c0-b8992409884c tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:54.919533 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d2f4782e-ea4f-43c8-80c0-b8992409884c tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:54.920256 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d2f4782e-ea4f-43c8-80c0-b8992409884c tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:54.920739 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d2f4782e-ea4f-43c8-80c0-b8992409884c tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:54.921163 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d2f4782e-ea4f-43c8-80c0-b8992409884c tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:54.937683 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-d2f4782e-ea4f-43c8-80c0-b8992409884c tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Getting quotas for project 267f4c2e27aa4f9db62c3877d948f3d9. Resources: {'instances', 'ram', 'cores'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 30 19:44:54.942127 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-d2f4782e-ea4f-43c8-80c0-b8992409884c tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Getting quotas for user eccbf92faf2b4bad8746a2a48f5a6226 and project 267f4c2e27aa4f9db62c3877d948f3d9. Resources: {'instances', 'ram', 'cores'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 30 19:44:54.996284 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-d2f4782e-ea4f-43c8-80c0-b8992409884c tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Going to run 1 instances... {{(pid=120648) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 30 19:44:54.998386 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-d2f4782e-ea4f-43c8-80c0-b8992409884c tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e4b51a9d-447d-476f-b462-e0033a1c99d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='90ab73a9-af3f-4e51-948c-6383b417be22',volume_size=None,volume_type=None)] {{(pid=120648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 30 19:44:55.123568 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-d2f4782e-ea4f-43c8-80c0-b8992409884c tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.688808 Sep 30 19:44:55.124218 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 585/1210] 10.222.0.17 () {60 vars in 1147 bytes} [Fri Sep 30 19:44:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 30 19:44:55.132932 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_api:SELECT=5 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:44:55.134233 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell1:SELECT=11 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:44:55.139676 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-5b70385b-1833-40c0-ac37-9f5f58fde138 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:44:55.140415 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-5b70385b-1833-40c0-ac37-9f5f58fde138 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e4b51a9d-447d-476f-b462-e0033a1c99d2] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:44:55.195376 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-5b70385b-1833-40c0-ac37-9f5f58fde138 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:44:55.202166 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-5b70385b-1833-40c0-ac37-9f5f58fde138 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/e4b51a9d-447d-476f-b462-e0033a1c99d2" status: 200 len: 1093 microversion: 2.1 time: 0.070807 Sep 30 19:44:55.202726 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 626/1211] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:44:55 2022] GET /compute/v2.1/servers/e4b51a9d-447d-476f-b462-e0033a1c99d2 => generated 1093 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:44:56.224523 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-29d57f2d-3fbb-48b4-89ea-c8a26387acf5 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:44:56.226542 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-29d57f2d-3fbb-48b4-89ea-c8a26387acf5 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e4b51a9d-447d-476f-b462-e0033a1c99d2] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:44:56.233610 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-29d57f2d-3fbb-48b4-89ea-c8a26387acf5 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:56.234503 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-29d57f2d-3fbb-48b4-89ea-c8a26387acf5 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:56.235166 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-29d57f2d-3fbb-48b4-89ea-c8a26387acf5 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:56.236382 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-29d57f2d-3fbb-48b4-89ea-c8a26387acf5 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:56.236844 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-29d57f2d-3fbb-48b4-89ea-c8a26387acf5 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:56.237269 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-29d57f2d-3fbb-48b4-89ea-c8a26387acf5 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:56.320812 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-29d57f2d-3fbb-48b4-89ea-c8a26387acf5 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:44:56.329343 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-29d57f2d-3fbb-48b4-89ea-c8a26387acf5 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/e4b51a9d-447d-476f-b462-e0033a1c99d2" status: 200 len: 1199 microversion: 2.1 time: 0.108748 Sep 30 19:44:56.330183 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 586/1212] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:44:56 2022] GET /compute/v2.1/servers/e4b51a9d-447d-476f-b462-e0033a1c99d2 => generated 1199 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:44:57.352081 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-242ce39f-9bbc-4197-849c-d967c977864e tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:44:57.352796 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-242ce39f-9bbc-4197-849c-d967c977864e tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e4b51a9d-447d-476f-b462-e0033a1c99d2] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:44:57.360025 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-242ce39f-9bbc-4197-849c-d967c977864e tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:57.360539 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-242ce39f-9bbc-4197-849c-d967c977864e tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:57.360973 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-242ce39f-9bbc-4197-849c-d967c977864e tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:57.361665 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-242ce39f-9bbc-4197-849c-d967c977864e tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:57.362116 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-242ce39f-9bbc-4197-849c-d967c977864e tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:57.362546 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-242ce39f-9bbc-4197-849c-d967c977864e tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:57.498391 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-242ce39f-9bbc-4197-849c-d967c977864e tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:44:57.506842 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-242ce39f-9bbc-4197-849c-d967c977864e tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/e4b51a9d-447d-476f-b462-e0033a1c99d2" status: 200 len: 1265 microversion: 2.1 time: 0.158662 Sep 30 19:44:57.507437 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 627/1213] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:44:57 2022] GET /compute/v2.1/servers/e4b51a9d-447d-476f-b462-e0033a1c99d2 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:44:57.636506 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-053998b6-6ba0-4776-96f7-a0dd6806383a req-3e6efa88-8284-4f09-aa4b-db8337181b24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4b51a9d-447d-476f-b462-e0033a1c99d2", "tag": "e60cb26c-9136-4a91-9857-dd856c6ddbef"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:44:57.647540 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-053998b6-6ba0-4776-96f7-a0dd6806383a req-3e6efa88-8284-4f09-aa4b-db8337181b24 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:57.648131 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-053998b6-6ba0-4776-96f7-a0dd6806383a req-3e6efa88-8284-4f09-aa4b-db8337181b24 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:57.648638 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-053998b6-6ba0-4776-96f7-a0dd6806383a req-3e6efa88-8284-4f09-aa4b-db8337181b24 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:57.660289 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-053998b6-6ba0-4776-96f7-a0dd6806383a req-3e6efa88-8284-4f09-aa4b-db8337181b24 service nova] Creating event network-changed:e60cb26c-9136-4a91-9857-dd856c6ddbef for instance e4b51a9d-447d-476f-b462-e0033a1c99d2 on hv-cinder-86001 Sep 30 19:44:57.665375 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-053998b6-6ba0-4776-96f7-a0dd6806383a req-3e6efa88-8284-4f09-aa4b-db8337181b24 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032754 Sep 30 19:44:57.665969 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 587/1214] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 30 19:44:58.530348 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-df4c1011-7b7c-496b-8794-2bbf26a1b79a tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:44:58.531024 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-df4c1011-7b7c-496b-8794-2bbf26a1b79a tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e4b51a9d-447d-476f-b462-e0033a1c99d2] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:44:58.538446 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-df4c1011-7b7c-496b-8794-2bbf26a1b79a tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:58.538925 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-df4c1011-7b7c-496b-8794-2bbf26a1b79a tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:58.539360 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-df4c1011-7b7c-496b-8794-2bbf26a1b79a tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:58.540042 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-df4c1011-7b7c-496b-8794-2bbf26a1b79a tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:58.540525 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-df4c1011-7b7c-496b-8794-2bbf26a1b79a tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:58.540949 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-df4c1011-7b7c-496b-8794-2bbf26a1b79a tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:58.667397 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-df4c1011-7b7c-496b-8794-2bbf26a1b79a tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:44:58.674886 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-df4c1011-7b7c-496b-8794-2bbf26a1b79a tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/e4b51a9d-447d-476f-b462-e0033a1c99d2" status: 200 len: 1265 microversion: 2.1 time: 0.148533 Sep 30 19:44:58.675442 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 628/1215] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:44:58 2022] GET /compute/v2.1/servers/e4b51a9d-447d-476f-b462-e0033a1c99d2 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:44:59.697787 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e727cc48-0436-40fa-ac50-95d00bf320a2 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:44:59.698614 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-e727cc48-0436-40fa-ac50-95d00bf320a2 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e4b51a9d-447d-476f-b462-e0033a1c99d2] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:44:59.705840 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e727cc48-0436-40fa-ac50-95d00bf320a2 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:59.706325 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e727cc48-0436-40fa-ac50-95d00bf320a2 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:59.706761 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e727cc48-0436-40fa-ac50-95d00bf320a2 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:59.707469 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e727cc48-0436-40fa-ac50-95d00bf320a2 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:44:59.707924 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e727cc48-0436-40fa-ac50-95d00bf320a2 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:44:59.708389 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e727cc48-0436-40fa-ac50-95d00bf320a2 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:44:59.922265 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-e727cc48-0436-40fa-ac50-95d00bf320a2 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:44:59.931148 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-e727cc48-0436-40fa-ac50-95d00bf320a2 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/e4b51a9d-447d-476f-b462-e0033a1c99d2" status: 200 len: 1265 microversion: 2.1 time: 0.237470 Sep 30 19:44:59.931735 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 588/1216] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:44:59 2022] GET /compute/v2.1/servers/e4b51a9d-447d-476f-b462-e0033a1c99d2 => generated 1265 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:45:00.954743 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-4d4df974-bc23-4010-9013-6d55fb368e26 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:45:00.955350 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-4d4df974-bc23-4010-9013-6d55fb368e26 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e4b51a9d-447d-476f-b462-e0033a1c99d2] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:45:00.961710 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4d4df974-bc23-4010-9013-6d55fb368e26 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:45:00.962193 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4d4df974-bc23-4010-9013-6d55fb368e26 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:45:00.962630 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4d4df974-bc23-4010-9013-6d55fb368e26 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:45:00.963319 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4d4df974-bc23-4010-9013-6d55fb368e26 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:45:00.963772 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4d4df974-bc23-4010-9013-6d55fb368e26 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:45:00.964197 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4d4df974-bc23-4010-9013-6d55fb368e26 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:45:01.095178 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-4d4df974-bc23-4010-9013-6d55fb368e26 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:45:01.102728 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-4d4df974-bc23-4010-9013-6d55fb368e26 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/e4b51a9d-447d-476f-b462-e0033a1c99d2" status: 200 len: 1265 microversion: 2.1 time: 0.152369 Sep 30 19:45:01.103306 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 629/1217] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:45:00 2022] GET /compute/v2.1/servers/e4b51a9d-447d-476f-b462-e0033a1c99d2 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:45:02.125402 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-5e1f88f0-eb0b-44e2-8b4f-f8c6e290b2b0 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:45:02.126534 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-5e1f88f0-eb0b-44e2-8b4f-f8c6e290b2b0 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e4b51a9d-447d-476f-b462-e0033a1c99d2] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:45:02.132857 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5e1f88f0-eb0b-44e2-8b4f-f8c6e290b2b0 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:45:02.133343 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5e1f88f0-eb0b-44e2-8b4f-f8c6e290b2b0 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:45:02.133779 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5e1f88f0-eb0b-44e2-8b4f-f8c6e290b2b0 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:45:02.134465 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5e1f88f0-eb0b-44e2-8b4f-f8c6e290b2b0 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:45:02.134924 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5e1f88f0-eb0b-44e2-8b4f-f8c6e290b2b0 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:45:02.135352 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5e1f88f0-eb0b-44e2-8b4f-f8c6e290b2b0 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:45:02.264878 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-5e1f88f0-eb0b-44e2-8b4f-f8c6e290b2b0 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:45:02.272453 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-5e1f88f0-eb0b-44e2-8b4f-f8c6e290b2b0 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/e4b51a9d-447d-476f-b462-e0033a1c99d2" status: 200 len: 1265 microversion: 2.1 time: 0.150974 Sep 30 19:45:02.273019 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 589/1218] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:45:02 2022] GET /compute/v2.1/servers/e4b51a9d-447d-476f-b462-e0033a1c99d2 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:45:03.295110 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-5e42f850-164b-4556-b159-188fac2466e2 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:45:03.295737 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-5e42f850-164b-4556-b159-188fac2466e2 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e4b51a9d-447d-476f-b462-e0033a1c99d2] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:45:03.302242 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5e42f850-164b-4556-b159-188fac2466e2 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:45:03.302730 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5e42f850-164b-4556-b159-188fac2466e2 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:45:03.303172 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5e42f850-164b-4556-b159-188fac2466e2 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:45:03.303870 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5e42f850-164b-4556-b159-188fac2466e2 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:45:03.304331 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5e42f850-164b-4556-b159-188fac2466e2 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:45:03.304785 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-5e42f850-164b-4556-b159-188fac2466e2 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:45:03.434733 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-5e42f850-164b-4556-b159-188fac2466e2 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:45:03.442965 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-5e42f850-164b-4556-b159-188fac2466e2 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/e4b51a9d-447d-476f-b462-e0033a1c99d2" status: 200 len: 1265 microversion: 2.1 time: 0.151740 Sep 30 19:45:03.443566 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 630/1219] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:45:03 2022] GET /compute/v2.1/servers/e4b51a9d-447d-476f-b462-e0033a1c99d2 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:45:04.465596 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-a7eea97f-47ce-4a6b-9920-95128d271e91 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:45:04.466210 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-a7eea97f-47ce-4a6b-9920-95128d271e91 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e4b51a9d-447d-476f-b462-e0033a1c99d2] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:45:04.473175 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a7eea97f-47ce-4a6b-9920-95128d271e91 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:45:04.473656 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a7eea97f-47ce-4a6b-9920-95128d271e91 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:45:04.474093 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a7eea97f-47ce-4a6b-9920-95128d271e91 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:45:04.474783 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a7eea97f-47ce-4a6b-9920-95128d271e91 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:45:04.475248 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a7eea97f-47ce-4a6b-9920-95128d271e91 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:45:04.475676 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a7eea97f-47ce-4a6b-9920-95128d271e91 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:45:04.607275 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-a7eea97f-47ce-4a6b-9920-95128d271e91 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:45:04.614860 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-a7eea97f-47ce-4a6b-9920-95128d271e91 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/e4b51a9d-447d-476f-b462-e0033a1c99d2" status: 200 len: 1265 microversion: 2.1 time: 0.153073 Sep 30 19:45:04.615417 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 590/1220] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:45:04 2022] GET /compute/v2.1/servers/e4b51a9d-447d-476f-b462-e0033a1c99d2 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:45:05.637632 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-6b1552ec-c8f6-42b4-a5e3-050230382709 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:45:05.638182 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-6b1552ec-c8f6-42b4-a5e3-050230382709 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e4b51a9d-447d-476f-b462-e0033a1c99d2] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:45:05.640526 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell0:SELECT=2 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:45:05.646067 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6b1552ec-c8f6-42b4-a5e3-050230382709 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:45:05.646530 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6b1552ec-c8f6-42b4-a5e3-050230382709 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:45:05.646959 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6b1552ec-c8f6-42b4-a5e3-050230382709 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:45:05.647641 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6b1552ec-c8f6-42b4-a5e3-050230382709 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:45:05.648090 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6b1552ec-c8f6-42b4-a5e3-050230382709 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:45:05.648546 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6b1552ec-c8f6-42b4-a5e3-050230382709 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:45:05.783937 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-6b1552ec-c8f6-42b4-a5e3-050230382709 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:45:05.791806 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-6b1552ec-c8f6-42b4-a5e3-050230382709 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/e4b51a9d-447d-476f-b462-e0033a1c99d2" status: 200 len: 1265 microversion: 2.1 time: 0.158120 Sep 30 19:45:05.792394 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 631/1221] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:45:05 2022] GET /compute/v2.1/servers/e4b51a9d-447d-476f-b462-e0033a1c99d2 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:45:06.815695 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-03a83fb5-56e5-4ab9-8672-5354bae742f0 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:45:06.816337 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-03a83fb5-56e5-4ab9-8672-5354bae742f0 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e4b51a9d-447d-476f-b462-e0033a1c99d2] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:45:06.818313 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=2 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:45:06.818966 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=6 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:45:06.825374 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-03a83fb5-56e5-4ab9-8672-5354bae742f0 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:45:06.826047 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-03a83fb5-56e5-4ab9-8672-5354bae742f0 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:45:06.826298 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-03a83fb5-56e5-4ab9-8672-5354bae742f0 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:45:06.827636 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-03a83fb5-56e5-4ab9-8672-5354bae742f0 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:45:06.827759 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-03a83fb5-56e5-4ab9-8672-5354bae742f0 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:45:06.828294 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-03a83fb5-56e5-4ab9-8672-5354bae742f0 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:45:06.965952 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-03a83fb5-56e5-4ab9-8672-5354bae742f0 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:45:06.973650 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-03a83fb5-56e5-4ab9-8672-5354bae742f0 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/e4b51a9d-447d-476f-b462-e0033a1c99d2" status: 200 len: 1265 microversion: 2.1 time: 0.162603 Sep 30 19:45:06.974423 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 591/1222] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:45:06 2022] GET /compute/v2.1/servers/e4b51a9d-447d-476f-b462-e0033a1c99d2 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:45:07.996878 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-0a739c2e-a962-4ee4-af37-a03d011d44f1 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:45:07.997527 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-0a739c2e-a962-4ee4-af37-a03d011d44f1 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e4b51a9d-447d-476f-b462-e0033a1c99d2] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:45:08.004583 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0a739c2e-a962-4ee4-af37-a03d011d44f1 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:45:08.005094 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0a739c2e-a962-4ee4-af37-a03d011d44f1 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:45:08.005519 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0a739c2e-a962-4ee4-af37-a03d011d44f1 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:45:08.006211 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0a739c2e-a962-4ee4-af37-a03d011d44f1 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:45:08.006694 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0a739c2e-a962-4ee4-af37-a03d011d44f1 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:45:08.007131 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0a739c2e-a962-4ee4-af37-a03d011d44f1 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:45:08.136788 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-0a739c2e-a962-4ee4-af37-a03d011d44f1 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:45:08.144961 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-0a739c2e-a962-4ee4-af37-a03d011d44f1 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/e4b51a9d-447d-476f-b462-e0033a1c99d2" status: 200 len: 1265 microversion: 2.1 time: 0.152009 Sep 30 19:45:08.145523 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 632/1223] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:45:07 2022] GET /compute/v2.1/servers/e4b51a9d-447d-476f-b462-e0033a1c99d2 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:45:09.167498 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-41859c9f-4a01-4871-b92e-084c9796e7e1 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:45:09.168153 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-41859c9f-4a01-4871-b92e-084c9796e7e1 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e4b51a9d-447d-476f-b462-e0033a1c99d2] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:45:09.174527 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-41859c9f-4a01-4871-b92e-084c9796e7e1 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:45:09.175004 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-41859c9f-4a01-4871-b92e-084c9796e7e1 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:45:09.175433 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-41859c9f-4a01-4871-b92e-084c9796e7e1 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:45:09.176115 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-41859c9f-4a01-4871-b92e-084c9796e7e1 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:45:09.176593 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-41859c9f-4a01-4871-b92e-084c9796e7e1 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:45:09.177017 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-41859c9f-4a01-4871-b92e-084c9796e7e1 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:45:09.303817 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-41859c9f-4a01-4871-b92e-084c9796e7e1 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:45:09.311462 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-41859c9f-4a01-4871-b92e-084c9796e7e1 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/e4b51a9d-447d-476f-b462-e0033a1c99d2" status: 200 len: 1265 microversion: 2.1 time: 0.147845 Sep 30 19:45:09.312022 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 592/1224] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:45:09 2022] GET /compute/v2.1/servers/e4b51a9d-447d-476f-b462-e0033a1c99d2 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:45:09.929551 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [req-4ff5bfa1-3eca-4471-9d27-b33bbe203dd9 req-af14beba-f9c2-450b-8888-5304f744c7ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4b51a9d-447d-476f-b462-e0033a1c99d2", "name": "network-vif-plugged", "status": "completed", "tag": "e60cb26c-9136-4a91-9857-dd856c6ddbef"}]} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:45:09.941744 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-4ff5bfa1-3eca-4471-9d27-b33bbe203dd9 req-af14beba-f9c2-450b-8888-5304f744c7ac service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:45:09.942481 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-4ff5bfa1-3eca-4471-9d27-b33bbe203dd9 req-af14beba-f9c2-450b-8888-5304f744c7ac service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:45:09.942931 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-4ff5bfa1-3eca-4471-9d27-b33bbe203dd9 req-af14beba-f9c2-450b-8888-5304f744c7ac service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:45:09.954063 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.compute.server_external_events [req-4ff5bfa1-3eca-4471-9d27-b33bbe203dd9 req-af14beba-f9c2-450b-8888-5304f744c7ac service nova] Creating event network-vif-plugged:e60cb26c-9136-4a91-9857-dd856c6ddbef for instance e4b51a9d-447d-476f-b462-e0033a1c99d2 on hv-cinder-86001 Sep 30 19:45:09.959191 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [req-4ff5bfa1-3eca-4471-9d27-b33bbe203dd9 req-af14beba-f9c2-450b-8888-5304f744c7ac service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033583 Sep 30 19:45:09.960032 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 633/1225] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:45:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:45:10.334652 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-0775f613-a633-4e5d-9e73-d6755208b522 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:45:10.335257 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-0775f613-a633-4e5d-9e73-d6755208b522 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e4b51a9d-447d-476f-b462-e0033a1c99d2] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:45:10.341548 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0775f613-a633-4e5d-9e73-d6755208b522 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:45:10.342021 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0775f613-a633-4e5d-9e73-d6755208b522 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:45:10.342449 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0775f613-a633-4e5d-9e73-d6755208b522 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:45:10.343126 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0775f613-a633-4e5d-9e73-d6755208b522 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:45:10.343571 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0775f613-a633-4e5d-9e73-d6755208b522 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:45:10.343992 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0775f613-a633-4e5d-9e73-d6755208b522 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:45:10.473156 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-0775f613-a633-4e5d-9e73-d6755208b522 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:45:10.480903 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-0775f613-a633-4e5d-9e73-d6755208b522 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/e4b51a9d-447d-476f-b462-e0033a1c99d2" status: 200 len: 1265 microversion: 2.1 time: 0.150119 Sep 30 19:45:10.481471 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 593/1226] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:45:10 2022] GET /compute/v2.1/servers/e4b51a9d-447d-476f-b462-e0033a1c99d2 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:45:11.504672 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-d8712ce0-1d2f-4c29-a31f-20b620176ad9 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:45:11.505369 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-d8712ce0-1d2f-4c29-a31f-20b620176ad9 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e4b51a9d-447d-476f-b462-e0033a1c99d2] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:45:11.511955 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d8712ce0-1d2f-4c29-a31f-20b620176ad9 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:45:11.512464 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d8712ce0-1d2f-4c29-a31f-20b620176ad9 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:45:11.512900 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d8712ce0-1d2f-4c29-a31f-20b620176ad9 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:45:11.513697 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d8712ce0-1d2f-4c29-a31f-20b620176ad9 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:45:11.514159 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d8712ce0-1d2f-4c29-a31f-20b620176ad9 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:45:11.514583 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-d8712ce0-1d2f-4c29-a31f-20b620176ad9 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:45:11.640692 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-d8712ce0-1d2f-4c29-a31f-20b620176ad9 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:45:11.648520 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-d8712ce0-1d2f-4c29-a31f-20b620176ad9 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/e4b51a9d-447d-476f-b462-e0033a1c99d2" status: 200 len: 1265 microversion: 2.1 time: 0.148697 Sep 30 19:45:11.649094 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 634/1227] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:45:11 2022] GET /compute/v2.1/servers/e4b51a9d-447d-476f-b462-e0033a1c99d2 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:45:12.671062 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-4166851c-01b6-4007-902e-650c36bf11b3 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:45:12.671596 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-4166851c-01b6-4007-902e-650c36bf11b3 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e4b51a9d-447d-476f-b462-e0033a1c99d2] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:45:12.678531 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4166851c-01b6-4007-902e-650c36bf11b3 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:45:12.679011 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4166851c-01b6-4007-902e-650c36bf11b3 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:45:12.679447 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4166851c-01b6-4007-902e-650c36bf11b3 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:45:12.680130 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4166851c-01b6-4007-902e-650c36bf11b3 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:45:12.680609 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4166851c-01b6-4007-902e-650c36bf11b3 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:45:12.681039 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4166851c-01b6-4007-902e-650c36bf11b3 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:45:12.810726 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-4166851c-01b6-4007-902e-650c36bf11b3 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:45:12.819337 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-4166851c-01b6-4007-902e-650c36bf11b3 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/e4b51a9d-447d-476f-b462-e0033a1c99d2" status: 200 len: 1452 microversion: 2.1 time: 0.152217 Sep 30 19:45:12.819901 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 594/1228] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:45:12 2022] GET /compute/v2.1/servers/e4b51a9d-447d-476f-b462-e0033a1c99d2 => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:45:12.840926 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-af75aa92-8d19-40f8-a721-2972085b3a3c tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:45:12.841545 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-af75aa92-8d19-40f8-a721-2972085b3a3c tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e4b51a9d-447d-476f-b462-e0033a1c99d2] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:45:12.848093 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-af75aa92-8d19-40f8-a721-2972085b3a3c tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:45:12.848628 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-af75aa92-8d19-40f8-a721-2972085b3a3c tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:45:12.849070 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-af75aa92-8d19-40f8-a721-2972085b3a3c tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:45:12.849770 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-af75aa92-8d19-40f8-a721-2972085b3a3c tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:45:12.850228 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-af75aa92-8d19-40f8-a721-2972085b3a3c tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:45:12.850661 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-af75aa92-8d19-40f8-a721-2972085b3a3c tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:45:12.982596 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-af75aa92-8d19-40f8-a721-2972085b3a3c tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:45:12.990687 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-af75aa92-8d19-40f8-a721-2972085b3a3c tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/e4b51a9d-447d-476f-b462-e0033a1c99d2" status: 200 len: 1452 microversion: 2.1 time: 0.153562 Sep 30 19:45:12.991257 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 635/1229] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:45:12 2022] GET /compute/v2.1/servers/e4b51a9d-447d-476f-b462-e0033a1c99d2 => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:45:14.633780 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-8773cb1a-7b95-4594-8b94-f1524b9774e6 req-993da203-03dc-48e9-8726-6ff57928dc81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4b51a9d-447d-476f-b462-e0033a1c99d2", "tag": "e60cb26c-9136-4a91-9857-dd856c6ddbef"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:45:14.644706 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-8773cb1a-7b95-4594-8b94-f1524b9774e6 req-993da203-03dc-48e9-8726-6ff57928dc81 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:45:14.645186 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-8773cb1a-7b95-4594-8b94-f1524b9774e6 req-993da203-03dc-48e9-8726-6ff57928dc81 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:45:14.645621 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-8773cb1a-7b95-4594-8b94-f1524b9774e6 req-993da203-03dc-48e9-8726-6ff57928dc81 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:45:14.656618 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-8773cb1a-7b95-4594-8b94-f1524b9774e6 req-993da203-03dc-48e9-8726-6ff57928dc81 service nova] Creating event network-changed:e60cb26c-9136-4a91-9857-dd856c6ddbef for instance e4b51a9d-447d-476f-b462-e0033a1c99d2 on hv-cinder-86001 Sep 30 19:45:14.662456 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-8773cb1a-7b95-4594-8b94-f1524b9774e6 req-993da203-03dc-48e9-8726-6ff57928dc81 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032202 Sep 30 19:45:14.663045 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 595/1230] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:45:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:45:53.974530 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-20df5f50-436f-444d-8415-6a4f8d294725 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:45:53.976805 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-20df5f50-436f-444d-8415-6a4f8d294725 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] [instance: 5745aded-4ca8-48ee-b8be-eff2e1a7368a] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:45:53.978933 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_api:SELECT=22 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:45:53.979576 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell1:SELECT=50 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:45:53.986399 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-20df5f50-436f-444d-8415-6a4f8d294725 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:45:53.986879 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-20df5f50-436f-444d-8415-6a4f8d294725 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:45:53.987801 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-20df5f50-436f-444d-8415-6a4f8d294725 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:45:53.989041 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-20df5f50-436f-444d-8415-6a4f8d294725 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:45:53.989503 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-20df5f50-436f-444d-8415-6a4f8d294725 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:45:53.989931 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-20df5f50-436f-444d-8415-6a4f8d294725 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:45:54.062717 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-20df5f50-436f-444d-8415-6a4f8d294725 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] 10.222.0.17 "POST /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a/action" status: 202 len: 0 microversion: 2.1 time: 0.091976 Sep 30 19:45:54.063415 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 636/1231] 10.222.0.17 () {60 vars in 1278 bytes} [Fri Sep 30 19:45:53 2022] POST /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 30 19:45:54.070246 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:45:54.071060 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=54 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:45:54.075957 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-73991202-3bd5-403a-8235-28181a3ff2a0 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:45:54.076815 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-73991202-3bd5-403a-8235-28181a3ff2a0 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] [instance: 5745aded-4ca8-48ee-b8be-eff2e1a7368a] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:45:54.084594 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-73991202-3bd5-403a-8235-28181a3ff2a0 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:45:54.085173 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-73991202-3bd5-403a-8235-28181a3ff2a0 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:45:54.085611 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-73991202-3bd5-403a-8235-28181a3ff2a0 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:45:54.086315 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-73991202-3bd5-403a-8235-28181a3ff2a0 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:45:54.086775 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-73991202-3bd5-403a-8235-28181a3ff2a0 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:45:54.087278 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-73991202-3bd5-403a-8235-28181a3ff2a0 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:45:54.313098 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-73991202-3bd5-403a-8235-28181a3ff2a0 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed107378a0a24db8962ac5da8c6dd961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7a0b8124ba4b51bcb69cb5ff459819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:45:54.321238 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-73991202-3bd5-403a-8235-28181a3ff2a0 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] 10.222.0.17 "GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a" status: 200 len: 1751 microversion: 2.1 time: 0.252762 Sep 30 19:45:54.321810 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 596/1232] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:45:54 2022] GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a => generated 1751 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:45:55.345540 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-b2eefab1-2be3-4438-9d6d-73a5ce4c5e3a tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:45:55.346247 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-b2eefab1-2be3-4438-9d6d-73a5ce4c5e3a tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] [instance: 5745aded-4ca8-48ee-b8be-eff2e1a7368a] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:45:55.352355 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b2eefab1-2be3-4438-9d6d-73a5ce4c5e3a tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:45:55.352872 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b2eefab1-2be3-4438-9d6d-73a5ce4c5e3a tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:45:55.353316 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b2eefab1-2be3-4438-9d6d-73a5ce4c5e3a tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:45:55.354013 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b2eefab1-2be3-4438-9d6d-73a5ce4c5e3a tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:45:55.354471 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b2eefab1-2be3-4438-9d6d-73a5ce4c5e3a tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:45:55.354902 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-b2eefab1-2be3-4438-9d6d-73a5ce4c5e3a tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:45:55.496112 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-b2eefab1-2be3-4438-9d6d-73a5ce4c5e3a tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed107378a0a24db8962ac5da8c6dd961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7a0b8124ba4b51bcb69cb5ff459819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:45:55.504935 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-b2eefab1-2be3-4438-9d6d-73a5ce4c5e3a tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] 10.222.0.17 "GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a" status: 200 len: 1756 microversion: 2.1 time: 0.164354 Sep 30 19:45:55.505499 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 637/1233] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:45:55 2022] GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:45:56.528232 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-c6335fd5-35d4-43f2-b818-307fe15297d2 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:45:56.528856 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-c6335fd5-35d4-43f2-b818-307fe15297d2 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] [instance: 5745aded-4ca8-48ee-b8be-eff2e1a7368a] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:45:56.535241 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c6335fd5-35d4-43f2-b818-307fe15297d2 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:45:56.535719 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c6335fd5-35d4-43f2-b818-307fe15297d2 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:45:56.536150 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c6335fd5-35d4-43f2-b818-307fe15297d2 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:45:56.537119 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c6335fd5-35d4-43f2-b818-307fe15297d2 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:45:56.537600 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c6335fd5-35d4-43f2-b818-307fe15297d2 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:45:56.538026 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c6335fd5-35d4-43f2-b818-307fe15297d2 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:45:56.678053 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-c6335fd5-35d4-43f2-b818-307fe15297d2 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed107378a0a24db8962ac5da8c6dd961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7a0b8124ba4b51bcb69cb5ff459819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:45:56.686090 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-c6335fd5-35d4-43f2-b818-307fe15297d2 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] 10.222.0.17 "GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a" status: 200 len: 1756 microversion: 2.1 time: 0.161797 Sep 30 19:45:56.686654 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 597/1234] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:45:56 2022] GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:45:57.711831 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-7dc6ecf9-969a-48d2-baa4-3ac41d7fb5bb tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:45:57.712459 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-7dc6ecf9-969a-48d2-baa4-3ac41d7fb5bb tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] [instance: 5745aded-4ca8-48ee-b8be-eff2e1a7368a] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:45:57.718779 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7dc6ecf9-969a-48d2-baa4-3ac41d7fb5bb tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:45:57.719251 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7dc6ecf9-969a-48d2-baa4-3ac41d7fb5bb tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:45:57.719680 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7dc6ecf9-969a-48d2-baa4-3ac41d7fb5bb tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:45:57.720382 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7dc6ecf9-969a-48d2-baa4-3ac41d7fb5bb tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:45:57.720837 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7dc6ecf9-969a-48d2-baa4-3ac41d7fb5bb tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:45:57.721253 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7dc6ecf9-969a-48d2-baa4-3ac41d7fb5bb tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:45:57.861810 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-7dc6ecf9-969a-48d2-baa4-3ac41d7fb5bb tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed107378a0a24db8962ac5da8c6dd961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7a0b8124ba4b51bcb69cb5ff459819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:45:57.869888 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-7dc6ecf9-969a-48d2-baa4-3ac41d7fb5bb tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] 10.222.0.17 "GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a" status: 200 len: 1756 microversion: 2.1 time: 0.161912 Sep 30 19:45:57.870453 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 638/1235] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:45:57 2022] GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:45:58.892842 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-8e4f11b3-258c-4d05-8b33-1f5a85666e68 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:45:58.893445 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-8e4f11b3-258c-4d05-8b33-1f5a85666e68 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] [instance: 5745aded-4ca8-48ee-b8be-eff2e1a7368a] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:45:58.899761 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8e4f11b3-258c-4d05-8b33-1f5a85666e68 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:45:58.900234 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8e4f11b3-258c-4d05-8b33-1f5a85666e68 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:45:58.900692 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8e4f11b3-258c-4d05-8b33-1f5a85666e68 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:45:58.901374 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8e4f11b3-258c-4d05-8b33-1f5a85666e68 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:45:58.901823 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8e4f11b3-258c-4d05-8b33-1f5a85666e68 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:45:58.902244 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8e4f11b3-258c-4d05-8b33-1f5a85666e68 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:45:59.056888 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-8e4f11b3-258c-4d05-8b33-1f5a85666e68 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed107378a0a24db8962ac5da8c6dd961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7a0b8124ba4b51bcb69cb5ff459819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:45:59.064984 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-8e4f11b3-258c-4d05-8b33-1f5a85666e68 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] 10.222.0.17 "GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a" status: 200 len: 1756 microversion: 2.1 time: 0.176029 Sep 30 19:45:59.065548 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 598/1236] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:45:58 2022] GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:46:00.087500 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-c80d14de-98be-4ac4-8993-d67fd0087c8e tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:46:00.088151 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-c80d14de-98be-4ac4-8993-d67fd0087c8e tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] [instance: 5745aded-4ca8-48ee-b8be-eff2e1a7368a] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:46:00.094573 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c80d14de-98be-4ac4-8993-d67fd0087c8e tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:46:00.095046 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c80d14de-98be-4ac4-8993-d67fd0087c8e tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:46:00.095477 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c80d14de-98be-4ac4-8993-d67fd0087c8e tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:46:00.096161 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c80d14de-98be-4ac4-8993-d67fd0087c8e tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:46:00.096636 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c80d14de-98be-4ac4-8993-d67fd0087c8e tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:46:00.097059 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-c80d14de-98be-4ac4-8993-d67fd0087c8e tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:46:00.240423 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-c80d14de-98be-4ac4-8993-d67fd0087c8e tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed107378a0a24db8962ac5da8c6dd961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7a0b8124ba4b51bcb69cb5ff459819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:46:00.248570 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-c80d14de-98be-4ac4-8993-d67fd0087c8e tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] 10.222.0.17 "GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a" status: 200 len: 1756 microversion: 2.1 time: 0.164849 Sep 30 19:46:00.249135 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 639/1237] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:46:00 2022] GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:46:01.272306 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-7642380c-afb4-43a9-8557-363cd0d53c90 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:46:01.272970 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-7642380c-afb4-43a9-8557-363cd0d53c90 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] [instance: 5745aded-4ca8-48ee-b8be-eff2e1a7368a] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:46:01.279234 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7642380c-afb4-43a9-8557-363cd0d53c90 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:46:01.279741 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7642380c-afb4-43a9-8557-363cd0d53c90 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:46:01.280171 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7642380c-afb4-43a9-8557-363cd0d53c90 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:46:01.280871 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7642380c-afb4-43a9-8557-363cd0d53c90 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:46:01.281319 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7642380c-afb4-43a9-8557-363cd0d53c90 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:46:01.281736 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7642380c-afb4-43a9-8557-363cd0d53c90 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:46:01.422453 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-7642380c-afb4-43a9-8557-363cd0d53c90 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed107378a0a24db8962ac5da8c6dd961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7a0b8124ba4b51bcb69cb5ff459819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:46:01.431015 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-7642380c-afb4-43a9-8557-363cd0d53c90 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] 10.222.0.17 "GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a" status: 200 len: 1756 microversion: 2.1 time: 0.163168 Sep 30 19:46:01.431572 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 599/1238] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:46:01 2022] GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:46:02.454804 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-7a9602f8-aec9-4d54-a5a2-9306cb80c475 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:46:02.455446 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-7a9602f8-aec9-4d54-a5a2-9306cb80c475 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] [instance: 5745aded-4ca8-48ee-b8be-eff2e1a7368a] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:46:02.462421 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7a9602f8-aec9-4d54-a5a2-9306cb80c475 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:46:02.462905 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7a9602f8-aec9-4d54-a5a2-9306cb80c475 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:46:02.463369 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7a9602f8-aec9-4d54-a5a2-9306cb80c475 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:46:02.464056 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7a9602f8-aec9-4d54-a5a2-9306cb80c475 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:46:02.464551 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7a9602f8-aec9-4d54-a5a2-9306cb80c475 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:46:02.464978 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7a9602f8-aec9-4d54-a5a2-9306cb80c475 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:46:02.604917 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-7a9602f8-aec9-4d54-a5a2-9306cb80c475 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed107378a0a24db8962ac5da8c6dd961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7a0b8124ba4b51bcb69cb5ff459819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:46:02.612965 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-7a9602f8-aec9-4d54-a5a2-9306cb80c475 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] 10.222.0.17 "GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a" status: 200 len: 1756 microversion: 2.1 time: 0.162070 Sep 30 19:46:02.613534 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 640/1239] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:46:02 2022] GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:46:03.636503 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e5fc101a-08db-44dc-86b8-8fa807d514b4 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:46:03.637043 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-e5fc101a-08db-44dc-86b8-8fa807d514b4 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] [instance: 5745aded-4ca8-48ee-b8be-eff2e1a7368a] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:46:03.643883 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e5fc101a-08db-44dc-86b8-8fa807d514b4 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:46:03.644358 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e5fc101a-08db-44dc-86b8-8fa807d514b4 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:46:03.644808 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e5fc101a-08db-44dc-86b8-8fa807d514b4 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:46:03.645482 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e5fc101a-08db-44dc-86b8-8fa807d514b4 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:46:03.645927 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e5fc101a-08db-44dc-86b8-8fa807d514b4 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:46:03.646343 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e5fc101a-08db-44dc-86b8-8fa807d514b4 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:46:03.786621 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-e5fc101a-08db-44dc-86b8-8fa807d514b4 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed107378a0a24db8962ac5da8c6dd961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7a0b8124ba4b51bcb69cb5ff459819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:46:03.795108 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-e5fc101a-08db-44dc-86b8-8fa807d514b4 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] 10.222.0.17 "GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a" status: 200 len: 1756 microversion: 2.1 time: 0.162530 Sep 30 19:46:03.795679 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 600/1240] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:46:03 2022] GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:46:04.817931 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-7ef5010e-d17f-46a8-ab62-1ba837e622e3 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:46:04.818543 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-7ef5010e-d17f-46a8-ab62-1ba837e622e3 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] [instance: 5745aded-4ca8-48ee-b8be-eff2e1a7368a] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:46:04.825417 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7ef5010e-d17f-46a8-ab62-1ba837e622e3 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:46:04.825845 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7ef5010e-d17f-46a8-ab62-1ba837e622e3 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:46:04.826281 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7ef5010e-d17f-46a8-ab62-1ba837e622e3 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:46:04.827003 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7ef5010e-d17f-46a8-ab62-1ba837e622e3 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:46:04.827455 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7ef5010e-d17f-46a8-ab62-1ba837e622e3 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:46:04.827881 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7ef5010e-d17f-46a8-ab62-1ba837e622e3 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:46:04.967517 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-7ef5010e-d17f-46a8-ab62-1ba837e622e3 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed107378a0a24db8962ac5da8c6dd961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7a0b8124ba4b51bcb69cb5ff459819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:46:04.976124 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-7ef5010e-d17f-46a8-ab62-1ba837e622e3 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] 10.222.0.17 "GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a" status: 200 len: 1756 microversion: 2.1 time: 0.162129 Sep 30 19:46:04.976727 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 641/1241] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:46:04 2022] GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:46:05.999890 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e28ca1b7-fc64-49c4-8894-262355e47cf9 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:46:06.000520 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-e28ca1b7-fc64-49c4-8894-262355e47cf9 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] [instance: 5745aded-4ca8-48ee-b8be-eff2e1a7368a] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:46:06.007741 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e28ca1b7-fc64-49c4-8894-262355e47cf9 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:46:06.008221 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e28ca1b7-fc64-49c4-8894-262355e47cf9 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:46:06.008702 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e28ca1b7-fc64-49c4-8894-262355e47cf9 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:46:06.009390 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e28ca1b7-fc64-49c4-8894-262355e47cf9 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:46:06.009840 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e28ca1b7-fc64-49c4-8894-262355e47cf9 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:46:06.010262 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e28ca1b7-fc64-49c4-8894-262355e47cf9 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:46:06.148492 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-e28ca1b7-fc64-49c4-8894-262355e47cf9 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed107378a0a24db8962ac5da8c6dd961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7a0b8124ba4b51bcb69cb5ff459819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:46:06.156660 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-e28ca1b7-fc64-49c4-8894-262355e47cf9 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] 10.222.0.17 "GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a" status: 200 len: 1756 microversion: 2.1 time: 0.160547 Sep 30 19:46:06.157227 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 601/1242] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:46:05 2022] GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:46:07.181547 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-4df87c5a-bc1f-4cbb-80a7-9306f1aaf454 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:46:07.182156 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-4df87c5a-bc1f-4cbb-80a7-9306f1aaf454 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] [instance: 5745aded-4ca8-48ee-b8be-eff2e1a7368a] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:46:07.188680 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4df87c5a-bc1f-4cbb-80a7-9306f1aaf454 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:46:07.189166 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4df87c5a-bc1f-4cbb-80a7-9306f1aaf454 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:46:07.189608 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4df87c5a-bc1f-4cbb-80a7-9306f1aaf454 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:46:07.190832 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4df87c5a-bc1f-4cbb-80a7-9306f1aaf454 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:46:07.191293 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4df87c5a-bc1f-4cbb-80a7-9306f1aaf454 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:46:07.191722 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-4df87c5a-bc1f-4cbb-80a7-9306f1aaf454 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:46:07.338659 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-4df87c5a-bc1f-4cbb-80a7-9306f1aaf454 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed107378a0a24db8962ac5da8c6dd961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7a0b8124ba4b51bcb69cb5ff459819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:46:07.346846 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-4df87c5a-bc1f-4cbb-80a7-9306f1aaf454 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] 10.222.0.17 "GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a" status: 200 len: 1759 microversion: 2.1 time: 0.169215 Sep 30 19:46:07.347412 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 642/1243] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:46:07 2022] GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a => generated 1759 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:47:06.212880 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=12 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:47:06.213627 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=36 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:47:06.214491 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 30 19:47:06.214631 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Fri Sep 30 19:47:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e4b51a9d-447d-476f-b462-e0033a1c99d2 (ip 10.222.0.17) !!! Sep 30 19:47:06.220041 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-c14447e1-6bf3-494e-9ae4-81099f98d4c6 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:47:06.220610 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-c14447e1-6bf3-494e-9ae4-81099f98d4c6 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e4b51a9d-447d-476f-b462-e0033a1c99d2] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:47:06.222046 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_api:SELECT=14 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:47:06.224032 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG dbcounter [-] [120649] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:47:06.230192 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c14447e1-6bf3-494e-9ae4-81099f98d4c6 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:47:06.231075 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c14447e1-6bf3-494e-9ae4-81099f98d4c6 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:47:06.231576 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c14447e1-6bf3-494e-9ae4-81099f98d4c6 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:47:06.232701 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c14447e1-6bf3-494e-9ae4-81099f98d4c6 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:47:06.233362 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c14447e1-6bf3-494e-9ae4-81099f98d4c6 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:47:06.234052 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c14447e1-6bf3-494e-9ae4-81099f98d4c6 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:47:06.262780 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-c14447e1-6bf3-494e-9ae4-81099f98d4c6 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e4b51a9d-447d-476f-b462-e0033a1c99d2] Going to try to terminate instance {{(pid=120648) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 30 19:47:06.325359 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [req-fc37f081-94e0-4cdf-9960-560e417cb96a req-fdd4a46c-895a-4405-80df-bd088f8cd3b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4b51a9d-447d-476f-b462-e0033a1c99d2", "tag": "e60cb26c-9136-4a91-9857-dd856c6ddbef"}]} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:47:06.337590 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-fc37f081-94e0-4cdf-9960-560e417cb96a req-fdd4a46c-895a-4405-80df-bd088f8cd3b2 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:47:06.338504 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-fc37f081-94e0-4cdf-9960-560e417cb96a req-fdd4a46c-895a-4405-80df-bd088f8cd3b2 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:47:06.339208 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-fc37f081-94e0-4cdf-9960-560e417cb96a req-fdd4a46c-895a-4405-80df-bd088f8cd3b2 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:47:06.350947 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-c14447e1-6bf3-494e-9ae4-81099f98d4c6 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e4b51a9d-447d-476f-b462-e0033a1c99d2" status: 204 len: 0 microversion: 2.1 time: 0.139276 Sep 30 19:47:06.351822 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 602/1244] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 30 19:47:06 2022] DELETE /compute/v2.1/servers/e4b51a9d-447d-476f-b462-e0033a1c99d2 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 30 19:47:06.354003 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.compute.server_external_events [req-fc37f081-94e0-4cdf-9960-560e417cb96a req-fdd4a46c-895a-4405-80df-bd088f8cd3b2 service nova] Creating event network-changed:e60cb26c-9136-4a91-9857-dd856c6ddbef for instance e4b51a9d-447d-476f-b462-e0033a1c99d2 on hv-cinder-86001 Sep 30 19:47:06.361018 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [req-fc37f081-94e0-4cdf-9960-560e417cb96a req-fdd4a46c-895a-4405-80df-bd088f8cd3b2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147124 Sep 30 19:47:06.361417 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-c52b862c-31a1-46b8-972e-9ef9480b5b17 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:47:06.362031 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 643/1245] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:47:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:47:06.365078 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-c52b862c-31a1-46b8-972e-9ef9480b5b17 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e4b51a9d-447d-476f-b462-e0033a1c99d2] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:47:06.370960 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c52b862c-31a1-46b8-972e-9ef9480b5b17 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:47:06.371448 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c52b862c-31a1-46b8-972e-9ef9480b5b17 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:47:06.371916 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c52b862c-31a1-46b8-972e-9ef9480b5b17 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:47:06.372658 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c52b862c-31a1-46b8-972e-9ef9480b5b17 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:47:06.373255 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c52b862c-31a1-46b8-972e-9ef9480b5b17 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:47:06.373681 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c52b862c-31a1-46b8-972e-9ef9480b5b17 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:47:06.504689 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-c52b862c-31a1-46b8-972e-9ef9480b5b17 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:47:06.512516 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-c52b862c-31a1-46b8-972e-9ef9480b5b17 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/e4b51a9d-447d-476f-b462-e0033a1c99d2" status: 200 len: 1577 microversion: 2.1 time: 0.155423 Sep 30 19:47:06.513092 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 603/1246] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:47:06 2022] GET /compute/v2.1/servers/e4b51a9d-447d-476f-b462-e0033a1c99d2 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:47:07.535650 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-ca8a5eba-e0c0-47e6-af9e-7c179ea39523 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:47:07.537003 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-ca8a5eba-e0c0-47e6-af9e-7c179ea39523 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e4b51a9d-447d-476f-b462-e0033a1c99d2] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:47:07.546765 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ca8a5eba-e0c0-47e6-af9e-7c179ea39523 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:47:07.547329 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ca8a5eba-e0c0-47e6-af9e-7c179ea39523 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:47:07.547770 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ca8a5eba-e0c0-47e6-af9e-7c179ea39523 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:47:07.548484 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ca8a5eba-e0c0-47e6-af9e-7c179ea39523 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:47:07.548980 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ca8a5eba-e0c0-47e6-af9e-7c179ea39523 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:47:07.549361 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-ca8a5eba-e0c0-47e6-af9e-7c179ea39523 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:47:07.684476 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-ca8a5eba-e0c0-47e6-af9e-7c179ea39523 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:47:07.692628 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-ca8a5eba-e0c0-47e6-af9e-7c179ea39523 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/e4b51a9d-447d-476f-b462-e0033a1c99d2" status: 200 len: 1577 microversion: 2.1 time: 0.161172 Sep 30 19:47:07.693203 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 644/1247] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:47:07 2022] GET /compute/v2.1/servers/e4b51a9d-447d-476f-b462-e0033a1c99d2 => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:47:08.715325 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-9aa707bd-1eba-4998-957a-8381302ebf4d tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:47:08.715941 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-9aa707bd-1eba-4998-957a-8381302ebf4d tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e4b51a9d-447d-476f-b462-e0033a1c99d2] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:47:08.722172 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9aa707bd-1eba-4998-957a-8381302ebf4d tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:47:08.722716 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9aa707bd-1eba-4998-957a-8381302ebf4d tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:47:08.723146 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9aa707bd-1eba-4998-957a-8381302ebf4d tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:47:08.723864 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9aa707bd-1eba-4998-957a-8381302ebf4d tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:47:08.724310 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9aa707bd-1eba-4998-957a-8381302ebf4d tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:47:08.724824 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9aa707bd-1eba-4998-957a-8381302ebf4d tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:47:08.725898 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [req-ea852cc5-8575-41b4-8d61-80636ef27ebf req-e48041ff-43f3-4c99-b4e5-5e1a13f7b515 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4b51a9d-447d-476f-b462-e0033a1c99d2", "name": "network-vif-deleted", "tag": "e60cb26c-9136-4a91-9857-dd856c6ddbef"}]} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:47:08.736683 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-ea852cc5-8575-41b4-8d61-80636ef27ebf req-e48041ff-43f3-4c99-b4e5-5e1a13f7b515 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:47:08.737174 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-ea852cc5-8575-41b4-8d61-80636ef27ebf req-e48041ff-43f3-4c99-b4e5-5e1a13f7b515 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:47:08.737619 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-ea852cc5-8575-41b4-8d61-80636ef27ebf req-e48041ff-43f3-4c99-b4e5-5e1a13f7b515 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:47:08.749000 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.compute.server_external_events [req-ea852cc5-8575-41b4-8d61-80636ef27ebf req-e48041ff-43f3-4c99-b4e5-5e1a13f7b515 service nova] Creating event network-vif-deleted:e60cb26c-9136-4a91-9857-dd856c6ddbef for instance e4b51a9d-447d-476f-b462-e0033a1c99d2 on hv-cinder-86001 Sep 30 19:47:08.754844 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [req-ea852cc5-8575-41b4-8d61-80636ef27ebf req-e48041ff-43f3-4c99-b4e5-5e1a13f7b515 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032051 Sep 30 19:47:08.755758 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 645/1248] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:47:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:47:08.787387 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-9aa707bd-1eba-4998-957a-8381302ebf4d tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:47:08.796275 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-9aa707bd-1eba-4998-957a-8381302ebf4d tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/e4b51a9d-447d-476f-b462-e0033a1c99d2" status: 200 len: 1390 microversion: 2.1 time: 0.084961 Sep 30 19:47:08.796877 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 604/1249] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:47:08 2022] GET /compute/v2.1/servers/e4b51a9d-447d-476f-b462-e0033a1c99d2 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:47:09.820409 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-8903f408-1318-46b4-8a87-3dc68c0b3728 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:47:09.821113 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-8903f408-1318-46b4-8a87-3dc68c0b3728 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e4b51a9d-447d-476f-b462-e0033a1c99d2] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:47:09.827159 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8903f408-1318-46b4-8a87-3dc68c0b3728 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:47:09.827644 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8903f408-1318-46b4-8a87-3dc68c0b3728 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:47:09.828088 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8903f408-1318-46b4-8a87-3dc68c0b3728 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:47:09.828912 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8903f408-1318-46b4-8a87-3dc68c0b3728 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:47:09.829372 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8903f408-1318-46b4-8a87-3dc68c0b3728 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:47:09.829802 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-8903f408-1318-46b4-8a87-3dc68c0b3728 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:47:09.843223 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.wsgi [None req-8903f408-1318-46b4-8a87-3dc68c0b3728 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] HTTP exception thrown: Instance e4b51a9d-447d-476f-b462-e0033a1c99d2 could not be found. Sep 30 19:47:09.844853 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-8903f408-1318-46b4-8a87-3dc68c0b3728 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Request method failure captured: Sep 30 19:47:09.844853 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: request: GET /compute/v2.1/servers/e4b51a9d-447d-476f-b462-e0033a1c99d2 HTTP/1.1 Sep 30 19:47:09.844853 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Accept: application/json Sep 30 19:47:09.844853 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Accept-Encoding: identity Sep 30 19:47:09.844853 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Connection: close Sep 30 19:47:09.844853 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Content-Length: 0 Sep 30 19:47:09.844853 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Content-Type: application/json Sep 30 19:47:09.844853 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Host: 10.222.0.17 Sep 30 19:47:09.844853 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Openstack-System-Scope: None Sep 30 19:47:09.844853 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: User-Agent: python-urllib3/1.26.12 Sep 30 19:47:09.844853 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Auth-Token: gAAAAABjN0WYog4ewqhpzDYMKJOk-jSueKDk3dvRdfwv4lcXuEz3D3wYQslucMkNqFipvDqlsEM4axRDbuCPAwlgKMMryNYmyT5a97xIFCUCZ2K1mz6d35kIyvQKc2M43GfAugRNLxMvzrpY0EcQcsrejcxXAIFctCgXJr6JoykiXCj5NqdCa2w Sep 30 19:47:09.844853 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Domain-Id: None Sep 30 19:47:09.844853 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Domain-Name: None Sep 30 19:47:09.844853 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Identity-Status: Confirmed Sep 30 19:47:09.844853 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Is-Admin-Project: True Sep 30 19:47:09.844853 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Domain-Id: default Sep 30 19:47:09.844853 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Domain-Name: Default Sep 30 19:47:09.844853 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Id: 267f4c2e27aa4f9db62c3877d948f3d9 Sep 30 19:47:09.844853 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Name: tempest-TestVolumeBootPattern-2055047970 Sep 30 19:47:09.844853 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Role: member,reader Sep 30 19:47:09.844853 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Roles: member,reader Sep 30 19:47:09.846735 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/267f4c2e27aa4f9db62c3877d948f3d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/267f4c2e27aa4f9db62c3877d948f3d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/267f4c2e27aa4f9db62c3877d948f3d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_267f4c2e27aa4f9db62c3877d948f3d9"}]}] Sep 30 19:47:09.846735 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant: tempest-TestVolumeBootPattern-2055047970 Sep 30 19:47:09.846735 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant-Id: 267f4c2e27aa4f9db62c3877d948f3d9 Sep 30 19:47:09.846735 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant-Name: tempest-TestVolumeBootPattern-2055047970 Sep 30 19:47:09.846735 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User: tempest-TestVolumeBootPattern-2055047970-project Sep 30 19:47:09.846735 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Domain-Id: default Sep 30 19:47:09.846735 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Domain-Name: Default Sep 30 19:47:09.846735 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Id: eccbf92faf2b4bad8746a2a48f5a6226 Sep 30 19:47:09.846735 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Name: tempest-TestVolumeBootPattern-2055047970-project Sep 30 19:47:09.846735 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: method: > Sep 30 19:47:09.846735 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: exception: Instance e4b51a9d-447d-476f-b462-e0033a1c99d2 could not be found. Sep 30 19:47:09.846735 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: action_args: {'id': 'e4b51a9d-447d-476f-b462-e0033a1c99d2'} Sep 30 19:47:09.848563 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:47:09.848563 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:47:09.848563 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 30 19:47:09.848563 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 30 19:47:09.848563 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 30 19:47:09.848563 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 30 19:47:09.848563 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 30 19:47:09.848563 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 30 19:47:09.848563 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 30 19:47:09.848563 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 30 19:47:09.848563 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4b51a9d-447d-476f-b462-e0033a1c99d2 could not be found. Sep 30 19:47:09.848563 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:47:09.848563 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:47:09.848563 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:47:09.848563 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:47:09.848563 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:47:09.848563 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:47:09.848563 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:47:09.848563 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:47:09.848563 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:47:09.850289 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:47:09.850289 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 30 19:47:09.850289 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 30 19:47:09.850289 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 30 19:47:09.850289 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 30 19:47:09.850289 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 30 19:47:09.850289 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 30 19:47:09.850289 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4b51a9d-447d-476f-b462-e0033a1c99d2 could not be found. Sep 30 19:47:09.850289 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:47:09.850289 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:47:09.850289 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:47:09.850289 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:47:09.850289 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:47:09.850289 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:47:09.850289 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:47:09.850289 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:47:09.850289 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4b51a9d-447d-476f-b462-e0033a1c99d2 could not be found. Sep 30 19:47:09.850289 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:47:09.852050 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-8903f408-1318-46b4-8a87-3dc68c0b3728 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Returning 404 to user: Instance e4b51a9d-447d-476f-b462-e0033a1c99d2 could not be found. {{(pid=120649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:47:09.852050 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-8903f408-1318-46b4-8a87-3dc68c0b3728 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/e4b51a9d-447d-476f-b462-e0033a1c99d2" status: 404 len: 111 microversion: 2.1 time: 0.030581 Sep 30 19:47:09.852050 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 646/1250] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:47:09 2022] GET /compute/v2.1/servers/e4b51a9d-447d-476f-b462-e0033a1c99d2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 30 19:47:10.752861 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-115a2f8a-8a8b-49f6-844e-57ba8859bb20 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-715180392"}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:47:10.753420 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-115a2f8a-8a8b-49f6-844e-57ba8859bb20 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] [instance: 5745aded-4ca8-48ee-b8be-eff2e1a7368a] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:47:10.760307 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-115a2f8a-8a8b-49f6-844e-57ba8859bb20 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:47:10.760814 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-115a2f8a-8a8b-49f6-844e-57ba8859bb20 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:47:10.761244 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-115a2f8a-8a8b-49f6-844e-57ba8859bb20 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:47:10.761925 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-115a2f8a-8a8b-49f6-844e-57ba8859bb20 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:47:10.762371 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-115a2f8a-8a8b-49f6-844e-57ba8859bb20 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:47:10.762788 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-115a2f8a-8a8b-49f6-844e-57ba8859bb20 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:47:10.889328 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.network.security_group_api [None req-115a2f8a-8a8b-49f6-844e-57ba8859bb20 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Removing security group 0672685f-52a7-415a-9814-d0139728860f from port a9e96422-58e5-4cac-bb52-22ea80779c20 Sep 30 19:47:11.192652 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-115a2f8a-8a8b-49f6-844e-57ba8859bb20 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] 10.222.0.17 "POST /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a/action" status: 202 len: 0 microversion: 2.1 time: 0.443698 Sep 30 19:47:11.193322 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 605/1251] 10.222.0.17 () {60 vars in 1278 bytes} [Fri Sep 30 19:47:10 2022] POST /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a/action => generated 0 bytes in 445 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 30 19:47:11.200283 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [req-06ff3e0d-ef62-48b2-a43e-6018928f2e04 req-55ee3f94-6882-4072-b2ab-6c923ac03d2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5745aded-4ca8-48ee-b8be-eff2e1a7368a", "tag": "a9e96422-58e5-4cac-bb52-22ea80779c20"}]} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:47:11.210233 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-06ff3e0d-ef62-48b2-a43e-6018928f2e04 req-55ee3f94-6882-4072-b2ab-6c923ac03d2c service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:47:11.210714 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-06ff3e0d-ef62-48b2-a43e-6018928f2e04 req-55ee3f94-6882-4072-b2ab-6c923ac03d2c service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:47:11.211146 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-06ff3e0d-ef62-48b2-a43e-6018928f2e04 req-55ee3f94-6882-4072-b2ab-6c923ac03d2c service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:47:11.224539 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.compute.server_external_events [req-06ff3e0d-ef62-48b2-a43e-6018928f2e04 req-55ee3f94-6882-4072-b2ab-6c923ac03d2c service nova] Creating event network-changed:a9e96422-58e5-4cac-bb52-22ea80779c20 for instance 5745aded-4ca8-48ee-b8be-eff2e1a7368a on hv-cinder-86001 Sep 30 19:47:11.230127 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [req-06ff3e0d-ef62-48b2-a43e-6018928f2e04 req-55ee3f94-6882-4072-b2ab-6c923ac03d2c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033511 Sep 30 19:47:11.230995 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 647/1252] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 30 19:47:12.887481 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [req-4673db88-7e77-44c1-a5a3-e44c61ae1dcc req-27115af5-5ef6-4887-8525-d9b30326e4e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5745aded-4ca8-48ee-b8be-eff2e1a7368a", "tag": "a9e96422-58e5-4cac-bb52-22ea80779c20"}]} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:47:12.890621 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-6902b810-bb41-419c-a9c3-935068876486 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:47:12.891126 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-6902b810-bb41-419c-a9c3-935068876486 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] [instance: 5745aded-4ca8-48ee-b8be-eff2e1a7368a] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:47:12.902557 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-4673db88-7e77-44c1-a5a3-e44c61ae1dcc req-27115af5-5ef6-4887-8525-d9b30326e4e6 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:47:12.903438 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6902b810-bb41-419c-a9c3-935068876486 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:47:12.904043 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-4673db88-7e77-44c1-a5a3-e44c61ae1dcc req-27115af5-5ef6-4887-8525-d9b30326e4e6 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:47:12.904284 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6902b810-bb41-419c-a9c3-935068876486 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:47:12.904718 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-4673db88-7e77-44c1-a5a3-e44c61ae1dcc req-27115af5-5ef6-4887-8525-d9b30326e4e6 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:47:12.905112 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6902b810-bb41-419c-a9c3-935068876486 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:47:12.905968 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6902b810-bb41-419c-a9c3-935068876486 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:47:12.906592 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6902b810-bb41-419c-a9c3-935068876486 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:47:12.907011 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6902b810-bb41-419c-a9c3-935068876486 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:47:12.922867 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.compute.server_external_events [req-4673db88-7e77-44c1-a5a3-e44c61ae1dcc req-27115af5-5ef6-4887-8525-d9b30326e4e6 service nova] Creating event network-changed:a9e96422-58e5-4cac-bb52-22ea80779c20 for instance 5745aded-4ca8-48ee-b8be-eff2e1a7368a on hv-cinder-86001 Sep 30 19:47:12.932868 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [req-4673db88-7e77-44c1-a5a3-e44c61ae1dcc req-27115af5-5ef6-4887-8525-d9b30326e4e6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048934 Sep 30 19:47:12.934454 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 648/1253] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:47:13.007351 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.objects.instance [None req-6902b810-bb41-419c-a9c3-935068876486 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lazy-loading 'services' on Instance uuid 5745aded-4ca8-48ee-b8be-eff2e1a7368a {{(pid=120648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 30 19:47:13.091836 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-6902b810-bb41-419c-a9c3-935068876486 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a/os-volume_attachments/cc6caef7-c033-4a97-ab4a-ff04ede48747" status: 202 len: 0 microversion: 2.1 time: 0.212690 Sep 30 19:47:13.093809 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 606/1254] 10.222.0.17 () {58 vars in 1416 bytes} [Fri Sep 30 19:47:12 2022] DELETE /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a/os-volume_attachments/cc6caef7-c033-4a97-ab4a-ff04ede48747 => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 30 19:47:13.103062 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-7b38c2b0-7e02-4f6c-a561-220d71e0b7f9 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:47:13.105708 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-7b38c2b0-7e02-4f6c-a561-220d71e0b7f9 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] [instance: 5745aded-4ca8-48ee-b8be-eff2e1a7368a] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:47:13.118492 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7b38c2b0-7e02-4f6c-a561-220d71e0b7f9 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:47:13.119452 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7b38c2b0-7e02-4f6c-a561-220d71e0b7f9 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:47:13.120078 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7b38c2b0-7e02-4f6c-a561-220d71e0b7f9 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:47:13.121039 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7b38c2b0-7e02-4f6c-a561-220d71e0b7f9 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:47:13.121713 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7b38c2b0-7e02-4f6c-a561-220d71e0b7f9 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:47:13.122321 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-7b38c2b0-7e02-4f6c-a561-220d71e0b7f9 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:47:13.165137 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-7b38c2b0-7e02-4f6c-a561-220d71e0b7f9 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] 10.222.0.17 "GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068578 Sep 30 19:47:13.165804 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 649/1255] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 30 19:47:13 2022] GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:47:13.763628 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-13bdb6b3-735f-4d0e-9efc-d142cb0b2510 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:47:13.764544 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-13bdb6b3-735f-4d0e-9efc-d142cb0b2510 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e9c06b75-e09a-4590-a6df-e8903fce4167] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:47:13.771858 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-13bdb6b3-735f-4d0e-9efc-d142cb0b2510 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:47:13.772888 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-13bdb6b3-735f-4d0e-9efc-d142cb0b2510 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:47:13.773548 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-13bdb6b3-735f-4d0e-9efc-d142cb0b2510 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:47:13.774518 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-13bdb6b3-735f-4d0e-9efc-d142cb0b2510 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:47:13.775192 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-13bdb6b3-735f-4d0e-9efc-d142cb0b2510 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:47:13.775853 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-13bdb6b3-735f-4d0e-9efc-d142cb0b2510 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:47:13.804226 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-13bdb6b3-735f-4d0e-9efc-d142cb0b2510 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e9c06b75-e09a-4590-a6df-e8903fce4167] Going to try to terminate instance {{(pid=120648) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 30 19:47:13.913285 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-13bdb6b3-735f-4d0e-9efc-d142cb0b2510 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167" status: 204 len: 0 microversion: 2.1 time: 0.153945 Sep 30 19:47:13.914504 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 607/1256] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 30 19:47:13 2022] DELETE /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 30 19:47:13.923142 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-76c7058e-4949-4e5a-b971-79a4c4826ebf tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:47:13.924291 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-76c7058e-4949-4e5a-b971-79a4c4826ebf tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e9c06b75-e09a-4590-a6df-e8903fce4167] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:47:13.930949 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-76c7058e-4949-4e5a-b971-79a4c4826ebf tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:47:13.931673 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-76c7058e-4949-4e5a-b971-79a4c4826ebf tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:47:13.932109 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-76c7058e-4949-4e5a-b971-79a4c4826ebf tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:47:13.932831 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-76c7058e-4949-4e5a-b971-79a4c4826ebf tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:47:13.933444 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-76c7058e-4949-4e5a-b971-79a4c4826ebf tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:47:13.934052 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-76c7058e-4949-4e5a-b971-79a4c4826ebf tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:47:14.121421 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-76c7058e-4949-4e5a-b971-79a4c4826ebf tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:47:14.129886 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-76c7058e-4949-4e5a-b971-79a4c4826ebf tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167" status: 200 len: 1579 microversion: 2.1 time: 0.210844 Sep 30 19:47:14.130517 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 650/1257] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:47:13 2022] GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167 => generated 1579 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:47:14.179154 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-af72aa49-2a3a-488d-a301-6198583ecf29 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:47:14.181426 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-af72aa49-2a3a-488d-a301-6198583ecf29 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] [instance: 5745aded-4ca8-48ee-b8be-eff2e1a7368a] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:47:14.187234 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-af72aa49-2a3a-488d-a301-6198583ecf29 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:47:14.187715 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-af72aa49-2a3a-488d-a301-6198583ecf29 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:47:14.188151 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-af72aa49-2a3a-488d-a301-6198583ecf29 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:47:14.188885 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-af72aa49-2a3a-488d-a301-6198583ecf29 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:47:14.189337 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-af72aa49-2a3a-488d-a301-6198583ecf29 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:47:14.189759 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-af72aa49-2a3a-488d-a301-6198583ecf29 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:47:14.222492 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-af72aa49-2a3a-488d-a301-6198583ecf29 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] 10.222.0.17 "GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048232 Sep 30 19:47:14.223121 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 608/1258] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 30 19:47:14 2022] GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 30 19:47:14.233928 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-0009be54-6703-413e-8aab-897f19ae754f tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:47:14.234430 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-0009be54-6703-413e-8aab-897f19ae754f tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] [instance: 5745aded-4ca8-48ee-b8be-eff2e1a7368a] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:47:14.240830 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0009be54-6703-413e-8aab-897f19ae754f tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:47:14.241549 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0009be54-6703-413e-8aab-897f19ae754f tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:47:14.241994 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0009be54-6703-413e-8aab-897f19ae754f tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:47:14.242700 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0009be54-6703-413e-8aab-897f19ae754f tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:47:14.243158 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0009be54-6703-413e-8aab-897f19ae754f tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:47:14.243585 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-0009be54-6703-413e-8aab-897f19ae754f tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:47:14.319039 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.wsgi [None req-0009be54-6703-413e-8aab-897f19ae754f tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] HTTP exception thrown: Instance 5745aded-4ca8-48ee-b8be-eff2e1a7368a is not attached to volume cc6caef7-c033-4a97-ab4a-ff04ede48747 Sep 30 19:47:14.321533 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-0009be54-6703-413e-8aab-897f19ae754f tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Request method failure captured: Sep 30 19:47:14.321533 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: request: DELETE /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a/os-volume_attachments/cc6caef7-c033-4a97-ab4a-ff04ede48747 HTTP/1.1 Sep 30 19:47:14.321533 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Accept: application/json Sep 30 19:47:14.321533 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Accept-Encoding: identity Sep 30 19:47:14.321533 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Connection: close Sep 30 19:47:14.321533 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Content-Length: 0 Sep 30 19:47:14.321533 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Content-Type: application/json Sep 30 19:47:14.321533 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Host: 10.222.0.17 Sep 30 19:47:14.321533 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Openstack-System-Scope: None Sep 30 19:47:14.321533 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: User-Agent: python-urllib3/1.26.12 Sep 30 19:47:14.321533 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Auth-Token: gAAAAABjN0b0n7O6BBMv0NkvcxMtia0gOhX8oKqnk769yFAoUdXmemiOwWzz8lucZ_zfbhrINHvJnTSsWTwTBHSHIK3a2-gPR2qz-hnfBxCiHDhPB6Wz2nkIGzzML8EWsvedQq9Dyed8ydXyrp2H4nJNQMNvjepx0cZ3AR-a5oXzqfeXsdsCUsU Sep 30 19:47:14.321533 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Domain-Id: None Sep 30 19:47:14.321533 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Domain-Name: None Sep 30 19:47:14.321533 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Identity-Status: Confirmed Sep 30 19:47:14.321533 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Is-Admin-Project: True Sep 30 19:47:14.321533 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Domain-Id: default Sep 30 19:47:14.321533 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Domain-Name: Default Sep 30 19:47:14.321533 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Id: 9b7a0b8124ba4b51bcb69cb5ff459819 Sep 30 19:47:14.321533 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Name: tempest-TestMinimumBasicScenario-824420234 Sep 30 19:47:14.321533 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Role: member,reader Sep 30 19:47:14.321533 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Roles: member,reader Sep 30 19:47:14.323342 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9b7a0b8124ba4b51bcb69cb5ff459819"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9b7a0b8124ba4b51bcb69cb5ff459819"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9b7a0b8124ba4b51bcb69cb5ff459819"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9b7a0b8124ba4b51bcb69cb5ff459819"}]}] Sep 30 19:47:14.323342 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant: tempest-TestMinimumBasicScenario-824420234 Sep 30 19:47:14.323342 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant-Id: 9b7a0b8124ba4b51bcb69cb5ff459819 Sep 30 19:47:14.323342 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant-Name: tempest-TestMinimumBasicScenario-824420234 Sep 30 19:47:14.323342 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User: tempest-TestMinimumBasicScenario-824420234-project Sep 30 19:47:14.323342 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Domain-Id: default Sep 30 19:47:14.323342 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Domain-Name: Default Sep 30 19:47:14.323342 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Id: ed107378a0a24db8962ac5da8c6dd961 Sep 30 19:47:14.323342 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Name: tempest-TestMinimumBasicScenario-824420234-project Sep 30 19:47:14.323342 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: method: > Sep 30 19:47:14.323342 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: exception: Instance 5745aded-4ca8-48ee-b8be-eff2e1a7368a is not attached to volume cc6caef7-c033-4a97-ab4a-ff04ede48747 Sep 30 19:47:14.324317 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: action_args: {'server_id': '5745aded-4ca8-48ee-b8be-eff2e1a7368a', 'id': 'cc6caef7-c033-4a97-ab4a-ff04ede48747'} Sep 30 19:47:14.324317 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:47:14.324317 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:47:14.324317 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 30 19:47:14.324317 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 30 19:47:14.324317 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 30 19:47:14.324317 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 30 19:47:14.324317 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 30 19:47:14.324317 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 30 19:47:14.324317 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id cc6caef7-c033-4a97-ab4a-ff04ede48747. Sep 30 19:47:14.324317 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:47:14.324317 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:47:14.324317 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:47:14.324317 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:47:14.324317 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:47:14.324317 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:47:14.324317 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:47:14.324317 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:47:14.324317 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:47:14.326294 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:47:14.326294 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 30 19:47:14.326294 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 30 19:47:14.326294 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5745aded-4ca8-48ee-b8be-eff2e1a7368a is not attached to volume cc6caef7-c033-4a97-ab4a-ff04ede48747 Sep 30 19:47:14.326294 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:47:14.326294 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:47:14.326294 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:47:14.326294 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:47:14.326294 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:47:14.326294 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:47:14.326294 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:47:14.326294 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:47:14.326294 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5745aded-4ca8-48ee-b8be-eff2e1a7368a is not attached to volume cc6caef7-c033-4a97-ab4a-ff04ede48747 Sep 30 19:47:14.326294 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:47:14.326294 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-0009be54-6703-413e-8aab-897f19ae754f tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Returning 404 to user: Instance 5745aded-4ca8-48ee-b8be-eff2e1a7368a is not attached to volume cc6caef7-c033-4a97-ab4a-ff04ede48747 {{(pid=120649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:47:14.327513 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-0009be54-6703-413e-8aab-897f19ae754f tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a/os-volume_attachments/cc6caef7-c033-4a97-ab4a-ff04ede48747" status: 404 len: 154 microversion: 2.1 time: 0.093759 Sep 30 19:47:14.327513 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 651/1259] 10.222.0.17 () {58 vars in 1416 bytes} [Fri Sep 30 19:47:14 2022] DELETE /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a/os-volume_attachments/cc6caef7-c033-4a97-ab4a-ff04ede48747 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 30 19:47:14.970466 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-05efc7b2-befa-4ed1-9933-ee0c26e3eb8b req-9cf5a96d-e0a4-41f0-9f83-771c8e853057 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9c06b75-e09a-4590-a6df-e8903fce4167", "tag": "c4655abc-d99b-4462-80dd-d51207134ed3"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:47:14.980653 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-05efc7b2-befa-4ed1-9933-ee0c26e3eb8b req-9cf5a96d-e0a4-41f0-9f83-771c8e853057 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:47:14.981126 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-05efc7b2-befa-4ed1-9933-ee0c26e3eb8b req-9cf5a96d-e0a4-41f0-9f83-771c8e853057 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:47:14.981553 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-05efc7b2-befa-4ed1-9933-ee0c26e3eb8b req-9cf5a96d-e0a4-41f0-9f83-771c8e853057 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:47:14.992013 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-05efc7b2-befa-4ed1-9933-ee0c26e3eb8b req-9cf5a96d-e0a4-41f0-9f83-771c8e853057 service nova] Creating event network-changed:c4655abc-d99b-4462-80dd-d51207134ed3 for instance e9c06b75-e09a-4590-a6df-e8903fce4167 on hv-cinder-86001 Sep 30 19:47:14.996773 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-05efc7b2-befa-4ed1-9933-ee0c26e3eb8b req-9cf5a96d-e0a4-41f0-9f83-771c8e853057 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030094 Sep 30 19:47:14.997506 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 609/1260] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:47:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:47:15.154483 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-00ddcfdd-cc3c-4ee4-83b5-3e8376dd4866 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:47:15.155281 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-00ddcfdd-cc3c-4ee4-83b5-3e8376dd4866 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e9c06b75-e09a-4590-a6df-e8903fce4167] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:47:15.164084 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-00ddcfdd-cc3c-4ee4-83b5-3e8376dd4866 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:47:15.164729 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-00ddcfdd-cc3c-4ee4-83b5-3e8376dd4866 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:47:15.165415 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-00ddcfdd-cc3c-4ee4-83b5-3e8376dd4866 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:47:15.166120 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-00ddcfdd-cc3c-4ee4-83b5-3e8376dd4866 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:47:15.166573 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-00ddcfdd-cc3c-4ee4-83b5-3e8376dd4866 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:47:15.166992 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-00ddcfdd-cc3c-4ee4-83b5-3e8376dd4866 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:47:15.379973 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-00ddcfdd-cc3c-4ee4-83b5-3e8376dd4866 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:47:15.389583 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-00ddcfdd-cc3c-4ee4-83b5-3e8376dd4866 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167" status: 200 len: 1579 microversion: 2.1 time: 0.239345 Sep 30 19:47:15.390469 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 652/1261] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:47:15 2022] GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167 => generated 1579 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:47:15.477015 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-6855db32-2fc4-487e-96ed-259aa703f4c1 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:47:15.477718 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-6855db32-2fc4-487e-96ed-259aa703f4c1 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] [instance: 5745aded-4ca8-48ee-b8be-eff2e1a7368a] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:47:15.483878 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6855db32-2fc4-487e-96ed-259aa703f4c1 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:47:15.484467 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6855db32-2fc4-487e-96ed-259aa703f4c1 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:47:15.484974 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6855db32-2fc4-487e-96ed-259aa703f4c1 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:47:15.485730 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6855db32-2fc4-487e-96ed-259aa703f4c1 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:47:15.486254 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6855db32-2fc4-487e-96ed-259aa703f4c1 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:47:15.486689 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6855db32-2fc4-487e-96ed-259aa703f4c1 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:47:15.512179 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-6855db32-2fc4-487e-96ed-259aa703f4c1 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] [instance: 5745aded-4ca8-48ee-b8be-eff2e1a7368a] Going to try to terminate instance {{(pid=120648) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 30 19:47:15.587023 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-6855db32-2fc4-487e-96ed-259aa703f4c1 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a" status: 204 len: 0 microversion: 2.1 time: 0.113756 Sep 30 19:47:15.587659 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 610/1262] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 30 19:47:15 2022] DELETE /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 30 19:47:15.596279 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-47198850-d706-429f-acae-08649c09b3bd tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:47:15.596929 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-47198850-d706-429f-acae-08649c09b3bd tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] [instance: 5745aded-4ca8-48ee-b8be-eff2e1a7368a] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:47:15.602951 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-47198850-d706-429f-acae-08649c09b3bd tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:47:15.603437 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-47198850-d706-429f-acae-08649c09b3bd tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:47:15.603905 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-47198850-d706-429f-acae-08649c09b3bd tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:47:15.604623 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-47198850-d706-429f-acae-08649c09b3bd tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:47:15.605084 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-47198850-d706-429f-acae-08649c09b3bd tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:47:15.605515 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-47198850-d706-429f-acae-08649c09b3bd tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:47:15.745886 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-47198850-d706-429f-acae-08649c09b3bd tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed107378a0a24db8962ac5da8c6dd961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7a0b8124ba4b51bcb69cb5ff459819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:47:15.754637 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-47198850-d706-429f-acae-08649c09b3bd tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] 10.222.0.17 "GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a" status: 200 len: 1554 microversion: 2.1 time: 0.161739 Sep 30 19:47:15.755211 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 653/1263] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:47:15 2022] GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 30 19:47:16.415030 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-942b7ba0-b979-4e28-ac4f-a9de06dac709 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:47:16.415725 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-942b7ba0-b979-4e28-ac4f-a9de06dac709 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e9c06b75-e09a-4590-a6df-e8903fce4167] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:47:16.422178 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-942b7ba0-b979-4e28-ac4f-a9de06dac709 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:47:16.422658 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-942b7ba0-b979-4e28-ac4f-a9de06dac709 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:47:16.423097 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-942b7ba0-b979-4e28-ac4f-a9de06dac709 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:47:16.423774 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-942b7ba0-b979-4e28-ac4f-a9de06dac709 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:47:16.424223 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-942b7ba0-b979-4e28-ac4f-a9de06dac709 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:47:16.424681 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-942b7ba0-b979-4e28-ac4f-a9de06dac709 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:47:16.486426 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-942b7ba0-b979-4e28-ac4f-a9de06dac709 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:47:16.494208 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-942b7ba0-b979-4e28-ac4f-a9de06dac709 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167" status: 200 len: 1392 microversion: 2.1 time: 0.084349 Sep 30 19:47:16.494772 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 611/1264] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:47:16 2022] GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167 => generated 1392 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:47:16.778329 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-e69d4b70-a22d-40ee-91a4-4c2c272b49d2 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:47:16.778929 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-e69d4b70-a22d-40ee-91a4-4c2c272b49d2 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] [instance: 5745aded-4ca8-48ee-b8be-eff2e1a7368a] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:47:16.785524 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e69d4b70-a22d-40ee-91a4-4c2c272b49d2 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:47:16.786010 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e69d4b70-a22d-40ee-91a4-4c2c272b49d2 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:47:16.786449 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e69d4b70-a22d-40ee-91a4-4c2c272b49d2 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:47:16.787145 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e69d4b70-a22d-40ee-91a4-4c2c272b49d2 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:47:16.787858 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e69d4b70-a22d-40ee-91a4-4c2c272b49d2 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:47:16.788287 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-e69d4b70-a22d-40ee-91a4-4c2c272b49d2 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:47:16.915393 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-e69d4b70-a22d-40ee-91a4-4c2c272b49d2 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed107378a0a24db8962ac5da8c6dd961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7a0b8124ba4b51bcb69cb5ff459819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:47:16.922986 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-e69d4b70-a22d-40ee-91a4-4c2c272b49d2 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] 10.222.0.17 "GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a" status: 200 len: 1554 microversion: 2.1 time: 0.148534 Sep 30 19:47:16.923553 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 654/1265] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:47:16 2022] GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:47:17.026099 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-488f1786-2a7a-4107-b1e9-b106f4e71c50 req-4aff81b3-d64d-442e-8edb-154bd985e356 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9c06b75-e09a-4590-a6df-e8903fce4167", "name": "network-vif-deleted", "tag": "c4655abc-d99b-4462-80dd-d51207134ed3"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:47:17.035283 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-488f1786-2a7a-4107-b1e9-b106f4e71c50 req-4aff81b3-d64d-442e-8edb-154bd985e356 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:47:17.035693 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-488f1786-2a7a-4107-b1e9-b106f4e71c50 req-4aff81b3-d64d-442e-8edb-154bd985e356 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:47:17.036130 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-488f1786-2a7a-4107-b1e9-b106f4e71c50 req-4aff81b3-d64d-442e-8edb-154bd985e356 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:47:17.047578 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-488f1786-2a7a-4107-b1e9-b106f4e71c50 req-4aff81b3-d64d-442e-8edb-154bd985e356 service nova] Creating event network-vif-deleted:c4655abc-d99b-4462-80dd-d51207134ed3 for instance e9c06b75-e09a-4590-a6df-e8903fce4167 on hv-cinder-86001 Sep 30 19:47:17.052937 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-488f1786-2a7a-4107-b1e9-b106f4e71c50 req-4aff81b3-d64d-442e-8edb-154bd985e356 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030422 Sep 30 19:47:17.053489 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 612/1266] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:47:17.516826 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-14afb109-7f17-47f6-9997-d692cf784c40 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:47:17.517430 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-14afb109-7f17-47f6-9997-d692cf784c40 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e9c06b75-e09a-4590-a6df-e8903fce4167] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:47:17.523304 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-14afb109-7f17-47f6-9997-d692cf784c40 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:47:17.523801 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-14afb109-7f17-47f6-9997-d692cf784c40 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:47:17.524219 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-14afb109-7f17-47f6-9997-d692cf784c40 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:47:17.524935 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-14afb109-7f17-47f6-9997-d692cf784c40 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:47:17.525380 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-14afb109-7f17-47f6-9997-d692cf784c40 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:47:17.525802 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-14afb109-7f17-47f6-9997-d692cf784c40 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:47:17.556465 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-14afb109-7f17-47f6-9997-d692cf784c40 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:47:17.556937 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-14afb109-7f17-47f6-9997-d692cf784c40 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:47:17.557368 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-14afb109-7f17-47f6-9997-d692cf784c40 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:47:17.557807 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.objects.instance [None req-14afb109-7f17-47f6-9997-d692cf784c40 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lazy-loading 'fault' on Instance uuid e9c06b75-e09a-4590-a6df-e8903fce4167 {{(pid=120649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 30 19:47:17.596836 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.policy [None req-14afb109-7f17-47f6-9997-d692cf784c40 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccbf92faf2b4bad8746a2a48f5a6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f4c2e27aa4f9db62c3877d948f3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120649) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:47:17.604803 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-14afb109-7f17-47f6-9997-d692cf784c40 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167" status: 200 len: 1230 microversion: 2.1 time: 0.091786 Sep 30 19:47:17.605363 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 655/1267] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:47:17 2022] GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167 => generated 1230 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:47:17.946584 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-391cd6f6-711c-4922-b667-1f37125d86d8 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:47:17.947191 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-391cd6f6-711c-4922-b667-1f37125d86d8 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] [instance: 5745aded-4ca8-48ee-b8be-eff2e1a7368a] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:47:17.953619 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-391cd6f6-711c-4922-b667-1f37125d86d8 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:47:17.954090 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-391cd6f6-711c-4922-b667-1f37125d86d8 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:47:17.954525 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-391cd6f6-711c-4922-b667-1f37125d86d8 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:47:17.955218 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-391cd6f6-711c-4922-b667-1f37125d86d8 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:47:17.955665 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-391cd6f6-711c-4922-b667-1f37125d86d8 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:47:17.956084 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-391cd6f6-711c-4922-b667-1f37125d86d8 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:47:18.171215 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-391cd6f6-711c-4922-b667-1f37125d86d8 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed107378a0a24db8962ac5da8c6dd961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7a0b8124ba4b51bcb69cb5ff459819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 30 19:47:18.178836 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-391cd6f6-711c-4922-b667-1f37125d86d8 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] 10.222.0.17 "GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a" status: 200 len: 1554 microversion: 2.1 time: 0.236520 Sep 30 19:47:18.179395 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 613/1268] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:47:17 2022] GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a => generated 1554 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 30 19:47:18.525477 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [req-20f14d7c-4f6f-4829-92cb-eca2ee34865a req-e31046ba-492d-43ba-a898-ba97b8b9afe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5745aded-4ca8-48ee-b8be-eff2e1a7368a", "name": "network-vif-deleted", "tag": "a9e96422-58e5-4cac-bb52-22ea80779c20"}]} {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 30 19:47:18.535178 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-20f14d7c-4f6f-4829-92cb-eca2ee34865a req-e31046ba-492d-43ba-a898-ba97b8b9afe2 service nova] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:47:18.535657 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-20f14d7c-4f6f-4829-92cb-eca2ee34865a req-e31046ba-492d-43ba-a898-ba97b8b9afe2 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:47:18.536086 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [req-20f14d7c-4f6f-4829-92cb-eca2ee34865a req-e31046ba-492d-43ba-a898-ba97b8b9afe2 service nova] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:47:18.547270 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.compute.server_external_events [req-20f14d7c-4f6f-4829-92cb-eca2ee34865a req-e31046ba-492d-43ba-a898-ba97b8b9afe2 service nova] Creating event network-vif-deleted:a9e96422-58e5-4cac-bb52-22ea80779c20 for instance 5745aded-4ca8-48ee-b8be-eff2e1a7368a on hv-cinder-86001 Sep 30 19:47:18.552818 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [req-20f14d7c-4f6f-4829-92cb-eca2ee34865a req-e31046ba-492d-43ba-a898-ba97b8b9afe2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110726 Sep 30 19:47:18.553405 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 656/1269] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 30 19:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 30 19:47:18.627854 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-fc07c5fd-89ba-4819-a723-9b48bdca94fe tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:47:18.628486 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-fc07c5fd-89ba-4819-a723-9b48bdca94fe tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: e9c06b75-e09a-4590-a6df-e8903fce4167] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:47:18.635081 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fc07c5fd-89ba-4819-a723-9b48bdca94fe tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:47:18.635625 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fc07c5fd-89ba-4819-a723-9b48bdca94fe tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:47:18.636069 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fc07c5fd-89ba-4819-a723-9b48bdca94fe tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:47:18.636803 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fc07c5fd-89ba-4819-a723-9b48bdca94fe tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:47:18.637265 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fc07c5fd-89ba-4819-a723-9b48bdca94fe tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:47:18.637693 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fc07c5fd-89ba-4819-a723-9b48bdca94fe tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:47:18.652881 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.wsgi [None req-fc07c5fd-89ba-4819-a723-9b48bdca94fe tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] HTTP exception thrown: Instance e9c06b75-e09a-4590-a6df-e8903fce4167 could not be found. Sep 30 19:47:18.654432 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-fc07c5fd-89ba-4819-a723-9b48bdca94fe tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Request method failure captured: Sep 30 19:47:18.654432 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: request: GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167 HTTP/1.1 Sep 30 19:47:18.654432 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 30 19:47:18.654432 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 30 19:47:18.654432 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Connection: close Sep 30 19:47:18.654432 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Length: 0 Sep 30 19:47:18.654432 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 30 19:47:18.654432 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Host: 10.222.0.17 Sep 30 19:47:18.654432 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 30 19:47:18.654432 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 30 19:47:18.654432 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjN0WYog4ewqhpzDYMKJOk-jSueKDk3dvRdfwv4lcXuEz3D3wYQslucMkNqFipvDqlsEM4axRDbuCPAwlgKMMryNYmyT5a97xIFCUCZ2K1mz6d35kIyvQKc2M43GfAugRNLxMvzrpY0EcQcsrejcxXAIFctCgXJr6JoykiXCj5NqdCa2w Sep 30 19:47:18.654432 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 30 19:47:18.654432 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 30 19:47:18.654432 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 30 19:47:18.654432 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 30 19:47:18.654432 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 30 19:47:18.654432 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 30 19:47:18.654432 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Id: 267f4c2e27aa4f9db62c3877d948f3d9 Sep 30 19:47:18.654432 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-TestVolumeBootPattern-2055047970 Sep 30 19:47:18.654432 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 30 19:47:18.654432 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 30 19:47:18.656283 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/267f4c2e27aa4f9db62c3877d948f3d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/267f4c2e27aa4f9db62c3877d948f3d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/267f4c2e27aa4f9db62c3877d948f3d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_267f4c2e27aa4f9db62c3877d948f3d9"}]}] Sep 30 19:47:18.656283 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-TestVolumeBootPattern-2055047970 Sep 30 19:47:18.656283 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Id: 267f4c2e27aa4f9db62c3877d948f3d9 Sep 30 19:47:18.656283 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-TestVolumeBootPattern-2055047970 Sep 30 19:47:18.656283 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User: tempest-TestVolumeBootPattern-2055047970-project Sep 30 19:47:18.656283 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 30 19:47:18.656283 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 30 19:47:18.656283 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Id: eccbf92faf2b4bad8746a2a48f5a6226 Sep 30 19:47:18.656283 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-TestVolumeBootPattern-2055047970-project Sep 30 19:47:18.656283 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: method: > Sep 30 19:47:18.656283 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: exception: Instance e9c06b75-e09a-4590-a6df-e8903fce4167 could not be found. Sep 30 19:47:18.656283 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: action_args: {'id': 'e9c06b75-e09a-4590-a6df-e8903fce4167'} Sep 30 19:47:18.657367 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:47:18.657367 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:47:18.657367 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 30 19:47:18.657367 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 30 19:47:18.657367 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 30 19:47:18.657367 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 30 19:47:18.657367 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 30 19:47:18.657367 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 30 19:47:18.657367 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 30 19:47:18.657367 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 30 19:47:18.657367 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9c06b75-e09a-4590-a6df-e8903fce4167 could not be found. Sep 30 19:47:18.657367 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:47:18.657367 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:47:18.657367 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:47:18.657367 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:47:18.657367 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:47:18.657367 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:47:18.657367 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:47:18.657367 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:47:18.657367 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:47:18.659465 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:47:18.659465 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 30 19:47:18.659465 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 30 19:47:18.659465 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 30 19:47:18.659465 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 30 19:47:18.659465 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 30 19:47:18.659465 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 30 19:47:18.659465 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9c06b75-e09a-4590-a6df-e8903fce4167 could not be found. Sep 30 19:47:18.659465 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:47:18.659465 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:47:18.659465 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:47:18.659465 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:47:18.659465 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:47:18.659465 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:47:18.659465 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:47:18.659465 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:47:18.659465 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9c06b75-e09a-4590-a6df-e8903fce4167 could not be found. Sep 30 19:47:18.659465 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:47:18.661099 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-fc07c5fd-89ba-4819-a723-9b48bdca94fe tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Returning 404 to user: Instance e9c06b75-e09a-4590-a6df-e8903fce4167 could not be found. {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:47:18.661099 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-fc07c5fd-89ba-4819-a723-9b48bdca94fe tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167" status: 404 len: 111 microversion: 2.1 time: 0.031739 Sep 30 19:47:18.661099 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 614/1270] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:47:18 2022] GET /compute/v2.1/servers/e9c06b75-e09a-4590-a6df-e8903fce4167 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 30 19:47:19.202362 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-258ffcbc-8f06-4ed3-a166-76d845a44b41 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:47:19.203087 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-258ffcbc-8f06-4ed3-a166-76d845a44b41 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] [instance: 5745aded-4ca8-48ee-b8be-eff2e1a7368a] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:47:19.209148 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-258ffcbc-8f06-4ed3-a166-76d845a44b41 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:47:19.209628 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-258ffcbc-8f06-4ed3-a166-76d845a44b41 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:47:19.210064 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-258ffcbc-8f06-4ed3-a166-76d845a44b41 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:47:19.210751 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-258ffcbc-8f06-4ed3-a166-76d845a44b41 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:47:19.211230 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-258ffcbc-8f06-4ed3-a166-76d845a44b41 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:47:19.211649 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-258ffcbc-8f06-4ed3-a166-76d845a44b41 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:47:19.225367 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.wsgi [None req-258ffcbc-8f06-4ed3-a166-76d845a44b41 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] HTTP exception thrown: Instance 5745aded-4ca8-48ee-b8be-eff2e1a7368a could not be found. Sep 30 19:47:19.226996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-258ffcbc-8f06-4ed3-a166-76d845a44b41 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Request method failure captured: Sep 30 19:47:19.226996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: request: GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a HTTP/1.1 Sep 30 19:47:19.226996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Accept: application/json Sep 30 19:47:19.226996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Accept-Encoding: identity Sep 30 19:47:19.226996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Connection: close Sep 30 19:47:19.226996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Content-Length: 0 Sep 30 19:47:19.226996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Content-Type: application/json Sep 30 19:47:19.226996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Host: 10.222.0.17 Sep 30 19:47:19.226996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Openstack-System-Scope: None Sep 30 19:47:19.226996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: User-Agent: python-urllib3/1.26.12 Sep 30 19:47:19.226996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Auth-Token: gAAAAABjN0b0n7O6BBMv0NkvcxMtia0gOhX8oKqnk769yFAoUdXmemiOwWzz8lucZ_zfbhrINHvJnTSsWTwTBHSHIK3a2-gPR2qz-hnfBxCiHDhPB6Wz2nkIGzzML8EWsvedQq9Dyed8ydXyrp2H4nJNQMNvjepx0cZ3AR-a5oXzqfeXsdsCUsU Sep 30 19:47:19.226996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Domain-Id: None Sep 30 19:47:19.226996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Domain-Name: None Sep 30 19:47:19.226996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Identity-Status: Confirmed Sep 30 19:47:19.226996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Is-Admin-Project: True Sep 30 19:47:19.226996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Domain-Id: default Sep 30 19:47:19.226996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Domain-Name: Default Sep 30 19:47:19.226996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Id: 9b7a0b8124ba4b51bcb69cb5ff459819 Sep 30 19:47:19.226996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Name: tempest-TestMinimumBasicScenario-824420234 Sep 30 19:47:19.226996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Role: member,reader Sep 30 19:47:19.226996 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Roles: member,reader Sep 30 19:47:19.228806 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9b7a0b8124ba4b51bcb69cb5ff459819"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9b7a0b8124ba4b51bcb69cb5ff459819"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9b7a0b8124ba4b51bcb69cb5ff459819"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9b7a0b8124ba4b51bcb69cb5ff459819"}]}] Sep 30 19:47:19.228806 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant: tempest-TestMinimumBasicScenario-824420234 Sep 30 19:47:19.228806 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant-Id: 9b7a0b8124ba4b51bcb69cb5ff459819 Sep 30 19:47:19.228806 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant-Name: tempest-TestMinimumBasicScenario-824420234 Sep 30 19:47:19.228806 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User: tempest-TestMinimumBasicScenario-824420234-project Sep 30 19:47:19.228806 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Domain-Id: default Sep 30 19:47:19.228806 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Domain-Name: Default Sep 30 19:47:19.228806 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Id: ed107378a0a24db8962ac5da8c6dd961 Sep 30 19:47:19.228806 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Name: tempest-TestMinimumBasicScenario-824420234-project Sep 30 19:47:19.228806 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: method: > Sep 30 19:47:19.228806 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: exception: Instance 5745aded-4ca8-48ee-b8be-eff2e1a7368a could not be found. Sep 30 19:47:19.228806 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: action_args: {'id': '5745aded-4ca8-48ee-b8be-eff2e1a7368a'} Sep 30 19:47:19.229925 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:47:19.229925 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:47:19.229925 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 30 19:47:19.229925 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 30 19:47:19.229925 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 30 19:47:19.229925 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 30 19:47:19.229925 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 30 19:47:19.229925 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 30 19:47:19.229925 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 30 19:47:19.229925 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 30 19:47:19.229925 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5745aded-4ca8-48ee-b8be-eff2e1a7368a could not be found. Sep 30 19:47:19.229925 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:47:19.229925 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:47:19.229925 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:47:19.229925 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:47:19.229925 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:47:19.229925 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:47:19.229925 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:47:19.229925 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:47:19.229925 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:47:19.231359 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:47:19.231359 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 30 19:47:19.231359 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 30 19:47:19.231359 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 30 19:47:19.231359 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 30 19:47:19.231359 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 30 19:47:19.231359 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 30 19:47:19.231359 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5745aded-4ca8-48ee-b8be-eff2e1a7368a could not be found. Sep 30 19:47:19.231359 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:47:19.231359 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:47:19.231359 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:47:19.231359 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:47:19.231359 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:47:19.231359 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:47:19.231359 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:47:19.231359 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:47:19.231359 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5745aded-4ca8-48ee-b8be-eff2e1a7368a could not be found. Sep 30 19:47:19.231359 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:47:19.232968 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-258ffcbc-8f06-4ed3-a166-76d845a44b41 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Returning 404 to user: Instance 5745aded-4ca8-48ee-b8be-eff2e1a7368a could not be found. {{(pid=120649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:47:19.232968 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-258ffcbc-8f06-4ed3-a166-76d845a44b41 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] 10.222.0.17 "GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a" status: 404 len: 111 microversion: 2.1 time: 0.030221 Sep 30 19:47:19.232968 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 657/1271] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:47:19 2022] GET /compute/v2.1/servers/5745aded-4ca8-48ee-b8be-eff2e1a7368a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 30 19:47:19.238130 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-80f8fdb6-8298-4047-9b8c-5985e07c2174 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] Calling method '.version_select at 0x7f6220779b80>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:47:19.260560 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-80f8fdb6-8298-4047-9b8c-5985e07c2174 tempest-TestMinimumBasicScenario-824420234 tempest-TestMinimumBasicScenario-824420234-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1189052628" status: 202 len: 0 microversion: 2.1 time: 0.026039 Sep 30 19:47:19.261125 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 615/1272] 10.222.0.17 () {58 vars in 1272 bytes} [Fri Sep 30 19:47:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1189052628 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 30 19:47:19.342860 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-6787bcf9-66b6-45c8-b9c7-bd9098bdc7ec tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:47:19.343497 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.compute.api [None req-6787bcf9-66b6-45c8-b9c7-bd9098bdc7ec tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: 9a0cc547-90fa-43de-b4f6-b1653194be5e] Fetching instance by UUID {{(pid=120649) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:47:19.350142 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6787bcf9-66b6-45c8-b9c7-bd9098bdc7ec tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:47:19.350924 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6787bcf9-66b6-45c8-b9c7-bd9098bdc7ec tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:47:19.351386 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6787bcf9-66b6-45c8-b9c7-bd9098bdc7ec tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:47:19.352155 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6787bcf9-66b6-45c8-b9c7-bd9098bdc7ec tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:47:19.352605 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6787bcf9-66b6-45c8-b9c7-bd9098bdc7ec tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:47:19.353023 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG oslo_concurrency.lockutils [None req-6787bcf9-66b6-45c8-b9c7-bd9098bdc7ec tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:47:19.367315 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.wsgi [None req-6787bcf9-66b6-45c8-b9c7-bd9098bdc7ec tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] HTTP exception thrown: Instance 9a0cc547-90fa-43de-b4f6-b1653194be5e could not be found. Sep 30 19:47:19.369041 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-6787bcf9-66b6-45c8-b9c7-bd9098bdc7ec tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Request method failure captured: Sep 30 19:47:19.369041 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: request: DELETE /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e HTTP/1.1 Sep 30 19:47:19.369041 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Accept: application/json Sep 30 19:47:19.369041 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Accept-Encoding: identity Sep 30 19:47:19.369041 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Connection: close Sep 30 19:47:19.369041 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Content-Length: 0 Sep 30 19:47:19.369041 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Content-Type: application/json Sep 30 19:47:19.369041 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Host: 10.222.0.17 Sep 30 19:47:19.369041 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: Openstack-System-Scope: None Sep 30 19:47:19.369041 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: User-Agent: python-urllib3/1.26.12 Sep 30 19:47:19.369041 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Auth-Token: gAAAAABjN0WYog4ewqhpzDYMKJOk-jSueKDk3dvRdfwv4lcXuEz3D3wYQslucMkNqFipvDqlsEM4axRDbuCPAwlgKMMryNYmyT5a97xIFCUCZ2K1mz6d35kIyvQKc2M43GfAugRNLxMvzrpY0EcQcsrejcxXAIFctCgXJr6JoykiXCj5NqdCa2w Sep 30 19:47:19.369041 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Domain-Id: None Sep 30 19:47:19.369041 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Domain-Name: None Sep 30 19:47:19.369041 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Identity-Status: Confirmed Sep 30 19:47:19.369041 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Is-Admin-Project: True Sep 30 19:47:19.369041 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Domain-Id: default Sep 30 19:47:19.369041 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Domain-Name: Default Sep 30 19:47:19.369041 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Id: 267f4c2e27aa4f9db62c3877d948f3d9 Sep 30 19:47:19.369041 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Project-Name: tempest-TestVolumeBootPattern-2055047970 Sep 30 19:47:19.369041 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Role: member,reader Sep 30 19:47:19.369041 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Roles: member,reader Sep 30 19:47:19.370837 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/267f4c2e27aa4f9db62c3877d948f3d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/267f4c2e27aa4f9db62c3877d948f3d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/267f4c2e27aa4f9db62c3877d948f3d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_267f4c2e27aa4f9db62c3877d948f3d9"}]}] Sep 30 19:47:19.370837 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant: tempest-TestVolumeBootPattern-2055047970 Sep 30 19:47:19.370837 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant-Id: 267f4c2e27aa4f9db62c3877d948f3d9 Sep 30 19:47:19.370837 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-Tenant-Name: tempest-TestVolumeBootPattern-2055047970 Sep 30 19:47:19.370837 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User: tempest-TestVolumeBootPattern-2055047970-project Sep 30 19:47:19.370837 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Domain-Id: default Sep 30 19:47:19.370837 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Domain-Name: Default Sep 30 19:47:19.370837 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Id: eccbf92faf2b4bad8746a2a48f5a6226 Sep 30 19:47:19.370837 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: X-User-Name: tempest-TestVolumeBootPattern-2055047970-project Sep 30 19:47:19.370837 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: method: > Sep 30 19:47:19.370837 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: exception: Instance 9a0cc547-90fa-43de-b4f6-b1653194be5e could not be found. Sep 30 19:47:19.370837 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: action_args: {'id': '9a0cc547-90fa-43de-b4f6-b1653194be5e'} Sep 30 19:47:19.372417 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:47:19.372417 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:47:19.372417 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 30 19:47:19.372417 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 30 19:47:19.372417 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 30 19:47:19.372417 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 30 19:47:19.372417 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 30 19:47:19.372417 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 30 19:47:19.372417 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 30 19:47:19.372417 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 30 19:47:19.372417 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a0cc547-90fa-43de-b4f6-b1653194be5e could not be found. Sep 30 19:47:19.372417 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:47:19.372417 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:47:19.372417 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:47:19.372417 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:47:19.372417 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:47:19.372417 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:47:19.372417 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:47:19.372417 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:47:19.372417 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:47:19.374301 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:47:19.374301 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 30 19:47:19.374301 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 30 19:47:19.374301 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 30 19:47:19.374301 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 30 19:47:19.374301 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 30 19:47:19.374301 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 30 19:47:19.374301 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 30 19:47:19.374301 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 30 19:47:19.374301 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a0cc547-90fa-43de-b4f6-b1653194be5e could not be found. Sep 30 19:47:19.374301 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:47:19.374301 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:47:19.374301 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:47:19.374301 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:47:19.374301 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:47:19.374301 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:47:19.374301 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:47:19.374301 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:47:19.374301 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a0cc547-90fa-43de-b4f6-b1653194be5e could not be found. Sep 30 19:47:19.374301 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: ERROR nova.api.openstack.wsgi Sep 30 19:47:19.375990 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-6787bcf9-66b6-45c8-b9c7-bd9098bdc7ec tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Returning 404 to user: Instance 9a0cc547-90fa-43de-b4f6-b1653194be5e could not be found. {{(pid=120649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:47:19.375990 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-6787bcf9-66b6-45c8-b9c7-bd9098bdc7ec tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "DELETE /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e" status: 404 len: 111 microversion: 2.1 time: 0.031465 Sep 30 19:47:19.375990 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 658/1273] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 30 19:47:19 2022] DELETE /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 30 19:47:19.381331 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-4a48282d-d20a-4984-b453-709e76e23c74 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:47:19.381950 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-4a48282d-d20a-4984-b453-709e76e23c74 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] [instance: 9a0cc547-90fa-43de-b4f6-b1653194be5e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 30 19:47:19.388619 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4a48282d-d20a-4984-b453-709e76e23c74 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:47:19.389105 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4a48282d-d20a-4984-b453-709e76e23c74 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:47:19.389541 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4a48282d-d20a-4984-b453-709e76e23c74 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:47:19.390234 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4a48282d-d20a-4984-b453-709e76e23c74 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Acquiring lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 19:47:19.390720 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4a48282d-d20a-4984-b453-709e76e23c74 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 19:47:19.391204 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4a48282d-d20a-4984-b453-709e76e23c74 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Lock "7dcc68f8-30fc-4dda-84fa-24b5f9a7d7fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 19:47:19.395900 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:47:19.408044 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.wsgi [None req-4a48282d-d20a-4984-b453-709e76e23c74 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] HTTP exception thrown: Instance 9a0cc547-90fa-43de-b4f6-b1653194be5e could not be found. Sep 30 19:47:19.409869 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-4a48282d-d20a-4984-b453-709e76e23c74 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Request method failure captured: Sep 30 19:47:19.409869 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: request: GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e HTTP/1.1 Sep 30 19:47:19.409869 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 30 19:47:19.409869 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 30 19:47:19.409869 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Connection: close Sep 30 19:47:19.409869 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Length: 0 Sep 30 19:47:19.409869 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 30 19:47:19.409869 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Host: 10.222.0.17 Sep 30 19:47:19.409869 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 30 19:47:19.409869 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 30 19:47:19.409869 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjN0WYog4ewqhpzDYMKJOk-jSueKDk3dvRdfwv4lcXuEz3D3wYQslucMkNqFipvDqlsEM4axRDbuCPAwlgKMMryNYmyT5a97xIFCUCZ2K1mz6d35kIyvQKc2M43GfAugRNLxMvzrpY0EcQcsrejcxXAIFctCgXJr6JoykiXCj5NqdCa2w Sep 30 19:47:19.409869 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 30 19:47:19.409869 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 30 19:47:19.409869 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 30 19:47:19.409869 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 30 19:47:19.409869 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 30 19:47:19.409869 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 30 19:47:19.409869 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Id: 267f4c2e27aa4f9db62c3877d948f3d9 Sep 30 19:47:19.409869 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-TestVolumeBootPattern-2055047970 Sep 30 19:47:19.409869 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 30 19:47:19.409869 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 30 19:47:19.412493 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/267f4c2e27aa4f9db62c3877d948f3d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/267f4c2e27aa4f9db62c3877d948f3d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/267f4c2e27aa4f9db62c3877d948f3d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_267f4c2e27aa4f9db62c3877d948f3d9"}]}] Sep 30 19:47:19.412493 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-TestVolumeBootPattern-2055047970 Sep 30 19:47:19.412493 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Id: 267f4c2e27aa4f9db62c3877d948f3d9 Sep 30 19:47:19.412493 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-TestVolumeBootPattern-2055047970 Sep 30 19:47:19.412493 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User: tempest-TestVolumeBootPattern-2055047970-project Sep 30 19:47:19.412493 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 30 19:47:19.412493 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 30 19:47:19.412493 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Id: eccbf92faf2b4bad8746a2a48f5a6226 Sep 30 19:47:19.412493 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-TestVolumeBootPattern-2055047970-project Sep 30 19:47:19.412493 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: method: > Sep 30 19:47:19.412493 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: exception: Instance 9a0cc547-90fa-43de-b4f6-b1653194be5e could not be found. Sep 30 19:47:19.412493 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: action_args: {'id': '9a0cc547-90fa-43de-b4f6-b1653194be5e'} Sep 30 19:47:19.413395 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 30 19:47:19.413395 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:47:19.413395 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 30 19:47:19.413395 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 30 19:47:19.413395 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 30 19:47:19.413395 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 30 19:47:19.413395 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 30 19:47:19.413395 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 30 19:47:19.413395 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 30 19:47:19.413395 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 30 19:47:19.413395 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a0cc547-90fa-43de-b4f6-b1653194be5e could not be found. Sep 30 19:47:19.413395 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:47:19.413395 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:47:19.413395 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:47:19.413395 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:47:19.413395 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:47:19.413395 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:47:19.413395 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 30 19:47:19.413395 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 30 19:47:19.413395 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 30 19:47:19.415004 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 30 19:47:19.415004 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 30 19:47:19.415004 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 30 19:47:19.415004 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 30 19:47:19.415004 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 30 19:47:19.415004 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 30 19:47:19.415004 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 30 19:47:19.415004 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a0cc547-90fa-43de-b4f6-b1653194be5e could not be found. Sep 30 19:47:19.415004 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:47:19.415004 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 30 19:47:19.415004 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:47:19.415004 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 30 19:47:19.415004 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 30 19:47:19.415004 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 30 19:47:19.415004 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 30 19:47:19.415004 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 30 19:47:19.415004 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a0cc547-90fa-43de-b4f6-b1653194be5e could not be found. Sep 30 19:47:19.415004 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 30 19:47:19.416428 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-4a48282d-d20a-4984-b453-709e76e23c74 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Returning 404 to user: Instance 9a0cc547-90fa-43de-b4f6-b1653194be5e could not be found. {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 30 19:47:19.416428 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-4a48282d-d20a-4984-b453-709e76e23c74 tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e" status: 404 len: 111 microversion: 2.1 time: 0.034454 Sep 30 19:47:19.416428 dv-cinder-860015-1-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 616/1274] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 30 19:47:19 2022] GET /compute/v2.1/servers/9a0cc547-90fa-43de-b4f6-b1653194be5e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 30 19:47:20.740072 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: DEBUG nova.api.openstack.wsgi [None req-6d252920-b79c-4bb1-92ff-6deb37d2066e tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] Calling method '.version_select at 0x7f62227bcca0>' {{(pid=120649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 30 19:47:20.793126 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: INFO nova.api.openstack.requestlog [None req-6d252920-b79c-4bb1-92ff-6deb37d2066e tempest-TestVolumeBootPattern-2055047970 tempest-TestVolumeBootPattern-2055047970-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-106744613" status: 202 len: 0 microversion: 2.1 time: 0.057387 Sep 30 19:47:20.794037 dv-cinder-860015-1-iscsi devstack@n-api.service[120649]: [pid: 120649|app: 0|req: 659/1275] 10.222.0.17 () {58 vars in 1260 bytes} [Fri Sep 30 19:47:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-106744613 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)